Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/examples/live_probe.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Live wire-validation probe: play the SMG frontend against a real headless
// vLLM EngineCore over ZMQ. Binds the handshake/input/output sockets, drives the
// handshake, submits one tokenized generate request, and prints the streamed
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/codec/dtype.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Adapted from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/dtype.rs and protocol/logprobs/array.rs.

Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/codec/mod.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Adapted from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/mod.rs.

Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/codec/tensor.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Adapted from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/tensor.rs and protocol/logprobs/array.rs.
//
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/connector.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// The connector: the frontend-side request/response layer over a
// [`ConnectedTransport`]. Adapted from the Apache-2.0 reference
// `vllm-engine-core-client` (vllm-project/vllm) client, scoped to SMG's needs:
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/error.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Error variants for the vLLM EngineCore protocol are adapted from the
// Apache-2.0 reference `vllm-engine-core-client` (vllm-project/vllm,
// rust/src/engine-core-client/src/error.rs). See crate root for provenance.
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/lib.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0

//! Engine-agnostic ZMQ transport + per-engine protocol modules for same-host
//! SMG backend connections.
//!
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/mock_engine.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Test-only mock engine, adapted from the Apache-2.0 reference
// `vllm-engine-core-client` (vllm-project/vllm): mock_engine.rs + test_utils.rs.
//
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/handshake.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/handshake.rs.

Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/mod.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0

//! Per-engine wire protocol modules plus the engine-neutral seam the transport
//! and connector are generic over.
//!
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/tokenspeed/mod.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0

//! TokenSpeed wire protocol.
//!
//! Clean-room port of TokenSpeed's native engine-IPC messages
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/tokenspeed/output.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// TokenSpeed per-step batched output — the native `BatchTokenIDOutSlim` from
// `io_struct.py`, a tagged `msgspec.Struct(array_like=True)`: on the wire it is
// a positional msgpack array with the class-name tag string as element 0.
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/tokenspeed/request.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// TokenSpeed tokenized generate request — the native `TokenizedGenerateReqInput`
// from `io_struct.py`, a tagged `msgspec.Struct(array_like=True)`: on the wire
// it is a positional msgpack array with the class-name tag string as element 0.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// TokenSpeed `SamplingParams` — a Python `msgspec.Struct(kw_only=True,
// array_like=True)` (runtime/sampling/sampling_params.py), so it rides the
// wire as an untagged positional msgpack array nested inside the tokenized
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/logprobs.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/logprobs.rs + protocol/logprobs/wire.rs.
// The numpy-array decoders live in `crate::codec::tensor`.
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/lora.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/lora.rs.

Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/mod.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0

//! vLLM EngineCore wire protocol.
//!
//! Clean-room port of vLLM's Apache-2.0 `vllm-engine-core-client`
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/output.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/output.rs.
//
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/request.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/request.rs.
//
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/sampling.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/sampling.rs.
//
Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/protocol/vllm/stats.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): protocol/stats.rs.

Expand Down
2 changes: 0 additions & 2 deletions crates/engine_zmq_client/src/transport.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// Ported from the Apache-2.0 reference `vllm-engine-core-client`
// (vllm-project/vllm): transport.rs.
//
Expand Down
2 changes: 0 additions & 2 deletions model_gateway/src/routers/grpc/zmq_client.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
// SPDX-License-Identifier: Apache-2.0
//
// ZMQ backend adapter (gateway glue): presents the vLLM engine surface (the same
// proto request/response types as `VllmEngineClient`) but speaks ZMQ directly to
// a same-host engine (vLLM EngineCore or TokenSpeed) via `engine-zmq-client`,
Expand Down
Loading