Chunk processing overhaul (#61)

* initial refactor

* more fixes and updates

* actually debugging the stream processor

* better, but still not factored correctly

* better factoring

* @tanstack/ai reviewed

* @tanstack/ai-client reviewed

* react-ui review

* react-ui review

* fixing up tests

* ci: apply automated fixes

* build fixes

* ci: apply automated fixes

* small type fix

* ci: apply automated fixes

* fix tests

* ci: apply automated fixes

* ci: apply automated fixes

* merge resolution

* ci: apply automated fixes

* fix test fails

* ci: apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Alem Tuzlak <t.zlak@hotmail.com>

Author: 3 people

.gitignore

@@ -49,3 +49,7 @@ temp
 
 vite.config.js.timestamp-*
 vite.config.ts.timestamp-*
+test-traces
+**/adapters/output
+.nitro
+.output

docs/api/ai-react.md

@@ -263,45 +263,6 @@ export function ChatWithClientTools() {
 }
 ```
 
-## `createServerFnTool(config)`
-
-**TanStack Start Integration** - Create a tool that works as both an AI tool and a server function.
-
-```typescript
-import { createServerFnTool } from "@tanstack/ai-react/start";
-import { z } from "zod";
-
-const getProducts = createServerFnTool({
-  name: "getProducts",
-  description: "Search for products",
-  inputSchema: z.object({
-    query: z.string(),
-  }),
-  outputSchema: z.array(
-    z.object({
-      id: z.string(),
-      name: z.string(),
-      price: z.number(),
-    })
-  ),
-  execute: async ({ query }) => {
-    return await db.products.search(query);
-  },
-});
-
-// Three variants from one definition:
-// 1. getProducts.toolDefinition - Pass to chat() for client execution
-// 2. getProducts.server - Pass to chat() for server execution
-// 3. await getProducts.serverFn({ query: 'laptop' }) - Call directly
-```
-
-**Returns:**
-- `toolDefinition` - For client-side tool execution
-- `server` - Server tool for AI chat
-- `serverFn` - Callable server function with Zod validation
-
-See [Server Function Tools](../guides/server-function-tools.md) for details.
-
 ## `createChatClientOptions(options)`
 
 Helper to create typed chat options (re-exported from `@tanstack/ai-client`).
@@ -349,5 +310,4 @@ Re-exported from `@tanstack/ai`:
 
 - [Getting Started](../getting-started/quick-start) - Learn the basics
 - [Tools Guide](../guides/tools) - Learn about the isomorphic tool system
-- [Server Function Tools](../guides/server-function-tools) - TanStack Start integration
 - [Client Tools](../guides/client-tools) - Learn about client-side tools

docs/api/ai-solid.md

@@ -277,45 +277,6 @@ export function ChatWithClientTools() {
 }
 ```
 
-## `createServerFnTool(config)`
-
-**Solid Start Integration** - Create a tool that works as both an AI tool and a server function.
-
-```typescript
-import { createServerFnTool } from "@tanstack/ai-solid/start";
-import { z } from "zod";
-
-const getProducts = createServerFnTool({
-  name: "getProducts",
-  description: "Search for products",
-  inputSchema: z.object({
-    query: z.string(),
-  }),
-  outputSchema: z.array(
-    z.object({
-      id: z.string(),
-      name: z.string(),
-      price: z.number(),
-    })
-  ),
-  execute: async ({ query }) => {
-    return await db.products.search(query);
-  },
-});
-
-// Three variants from one definition:
-// 1. getProducts.toolDefinition - Pass to chat() for client execution
-// 2. getProducts.server - Pass to chat() for server execution
-// 3. await getProducts.serverFn({ query: 'laptop' }) - Call directly
-```
-
-**Returns:**
-- `toolDefinition` - For client-side tool execution
-- `server` - Server tool for AI chat
-- `serverFn` - Callable server function with Zod validation
-
-See [Server Function Tools](../guides/server-function-tools.md) for details.
-
 ## `createChatClientOptions(options)`
 
 Helper to create typed chat options (re-exported from `@tanstack/ai-client`).
@@ -364,5 +325,4 @@ Re-exported from `@tanstack/ai`:
 
 - [Getting Started](../getting-started/quick-start) - Learn the basics
 - [Tools Guide](../guides/tools) - Learn about the isomorphic tool system
-- [Server Function Tools](../guides/server-function-tools) - Solid Start integration
 - [Client Tools](../guides/client-tools) - Learn about client-side tools

docs/getting-started/overview.md

@@ -11,39 +11,30 @@ TanStack AI works great with:
 - **Remix Router v7** - Loaders and actions
 - **Any framework** - Framework-agnostic core
 
-## Enhanced with TanStack Start
+## Framework Agnostic
 
-TanStack AI works with any framework using `toolDefinition()` and `.server()`. 
+TanStack AI works with any framework using `toolDefinition()` and `.server()`:
 
-**With TanStack Start**, you get a bonus: `createServerFnTool` lets you share implementations between AI tools and server functions:
-
-**Example:**
 ```typescript
-import { createServerFnTool } from '@tanstack/ai-react/start'
+import { toolDefinition } from '@tanstack/ai'
 
-// Define once, get both AI tool AND callable server function
-const getProducts = createServerFnTool({
+// Define a tool
+const getProductsDef = toolDefinition({
   name: 'getProducts',
   inputSchema: z.object({ query: z.string() }),
   outputSchema: z.array(z.object({ id: z.string(), name: z.string() })),
-  execute: async ({ query }) => db.products.search(query),
 })
 
-// Use in AI chat
-chat({ tools: [getProducts.server] })
+// Create server implementation
+const getProducts = getProductsDef.server(async ({ query }) => {
+  return await db.products.search(query)
+})
 
-// Call directly from components (TanStack Start only!)
-const products = await getProducts.serverFn({ query: 'guitar' })
+// Use in AI chat
+chat({ tools: [getProducts] })
 ```
 
-**TanStack Start Benefits:**
-- ✅ No duplicate logic between AI tools and server functions
-- ✅ Call server functions directly from components (no API endpoints needed)
-- ✅ Full type safety everywhere
-
-See [Server Function Tools](../guides/server-function-tools.md) for more details.
-
-**Note:** The base library works with any framework. `createServerFnTool` is optional and TanStack Start-specific.
+The base library works with any framework!
 
 ## Core Packages
 
@@ -69,15 +60,13 @@ React hooks for TanStack AI:
 - Automatic state management
 - Tool approval flow support
 - Type-safe message handling with `InferChatMessages`
-- `createServerFnTool` for TanStack Start integration
 
 ### `@tanstack/ai-solid`
 Solid hooks for TanStack AI:
 - `useChat` hook for chat interfaces
 - Automatic state management
 - Tool approval flow support
 - Type-safe message handling with `InferChatMessages`
-- `createServerFnTool` for Solid Start integration
 
 ## Adapters
 
@@ -94,7 +83,6 @@ TanStack AI supports multiple LLM providers through adapters:
 - ✅ **Streaming** - Built-in streaming support for real-time responses
 - ✅ **Isomorphic Tools** - Define once with `toolDefinition()`, implement with `.server()` or `.client()`
 - ✅ **Framework Agnostic** - Core library works anywhere
-- ✅ **TanStack Start Integration** - Share logic between AI tools and server functions with `createServerFnTool`
 - ✅ **Multiple Providers** - OpenAI, Anthropic, Gemini, Ollama, and more
 - ✅ **Approval Flow** - Built-in support for tool approval workflows
 - ✅ **Automatic Execution** - Both server and client tools execute automatically
@@ -103,6 +91,5 @@ TanStack AI supports multiple LLM providers through adapters:
 
 - [Quick Start Guide](./quick-start) - Get up and running in minutes
 - [Tools Guide](../guides/tools) - Learn about the isomorphic tool system
-- [Server Function Tools](../guides/server-function-tools) - TanStack Start integration
 - [API Reference](../api/ai) - Explore the full API
 

docs/getting-started/quick-start.md

@@ -164,11 +164,10 @@ You now have a working chat application. The `useChat` hook handles:
 - Loading states
 - Error handling
 
-## Bonus: TanStack Start Integration
+## Using Tools
 
-TanStack AI works with any framework. If you're using **TanStack Start** specifically, you get a bonus: `createServerFnTool` lets you share implementations between AI tools and server functions.
+TanStack AI works with any framework. Here's how to use tools:
 
-**Standard approach (any framework):**
 ```typescript
 import { toolDefinition } from '@tanstack/ai'
 
@@ -184,35 +183,8 @@ const getProducts = getProductsDef.server(async ({ query }) => {
 chat({ tools: [getProducts] })
 ```
 
-**TanStack Start bonus:**
-```typescript
-import { createServerFnTool } from '@tanstack/ai-react/start'
-
-// Get AI tool AND callable server function from one definition
-const getProducts = createServerFnTool({
-  name: 'getProducts',
-  inputSchema: z.object({ query: z.string() }),
-  outputSchema: z.array(z.object({ id: z.string(), name: z.string() })),
-  execute: async ({ query }) => db.products.search(query),
-})
-
-// Use in AI chat
-chat({ tools: [getProducts.server] })
-
-// Call directly from components (TanStack Start only!)
-const products = await getProducts.serverFn({ query: 'laptop' })
-```
-
-**TanStack Start Benefits:**
-- ✅ No duplicate logic between AI tools and server functions
-- ✅ Call server functions directly from components
-- ✅ No extra API endpoints needed
-
-Learn more in the [Server Function Tools](../guides/server-function-tools.md) guide.
-
 ## Next Steps
 
 - Learn about [Tools](../guides/tools) to add function calling
-- Explore [Server Function Tools](../guides/server-function-tools) for TanStack Start integration
 - Check out [Client Tools](../guides/client-tools) for frontend operations
 - See the [API Reference](../api/ai) for more options