Hello there!

ObjectWeaver is a schema-driven approach written in Go for orchestrating LLMs to return their responses in a JSON format (matching the format of the schema).

Link to repo: https://github.com/ObjectWeaver/ObjectWeaver
Link to docs: https://objectweaver.dev/
Link to docker image: https://hub.docker.com/repositories/objectweaver

How it works?

ObjectWeaver uses a field-driven schema approach to generate as many fields concurrently as possible. Leading to a:

Significant latency reduction compared to serial generation.
It reduces context pollution by allowing specific contexts for specific fields.

Basic Example

 requestBody := RequestBody{ Prompt: "Generate a schema that defines the technological landscape of the world", Definition: &Definition{ Type: "object", Instruction: "Defines the technological landscape of the world, including its level of advancement and notable innovations.", Properties: map[string]Property{ "Level": { Type: "string", Instruction: "Categorize the overall technological sophistication of the world, such as medieval, industrial, or advanced futuristic.", }, "Inventions": { Type: "string", Instruction: "Describe the most significant technological discoveries and their transformative impact on the society, economy, and daily life.", }, }, }, }

Outputs:

 { "Level": "Advanced Industrial with Magical Integration", "Inventions": "The world's most transformative innovation is Aether-Steam Engines, which combine magical essence extraction with mechanical steam power. This hybrid technology has revolutionized transportation through sky-ships and rail networks, reshaped manufacturing by enabling enchantment assembly lines, and democratized access to both magical and mechanical tools, fundamentally altering the economic landscape and social mobility patterns." }

I'm looking for feedback on the implementation and the API design. I imagine there are edge cases I haven't caught yet, so I'd appreciate any eyes on the repo.

Thanks for having a look!

submitted by /u/HazLimb
[link] [comments]

ObjectWeaver: A Docker image for concurrent, schema-driven LLM JSON generation

Quick Overview

Key Points

Outline