Search results

Introduce profiling to find bottlenecks on throughput

atoma-service

optimizations

Status: Open.

#660 In AtomaAI/atoma-node;

· maschad opened on Jun 4, 2025

Add KV Cache Manager to track block metrics

atoma-vllm

enhancementNew feature or requestNew feature or request

metrics

Status: Open.

Feature

#415 In AtomaAI/atoma-node;

· maschad opened on Feb 15, 2025

Streamed final chunk has response hash and signature being computed with usage

Status: Open.

#345 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Jan 19, 2025

Synchronization between proxy and node is desired

atoma-service

failure-path

important

liveness

sui

Status: Open.

#334 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Jan 10, 2025

Both atoma service confidential ciphertext, salt and nonce should be base64 encoded

atoma-service

confidential-compute

Status: Open.

#318 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 30, 2024

Add proper token update to the db, in case generating a inference response fails

Status: Open.

#316 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 30, 2024

Investigate why logs are not being stored

good first issueGood for newcomersGood for newcomers

Status: Open.

#304 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 24, 2024

Add tgi backend support

good first issueGood for newcomersGood for newcomers

Status: Open.

#295 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 20, 2024

Add docker compose build images for both confidential and non-confidential options

good first issueGood for newcomersGood for newcomers

Status: Open.

#293 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 19, 2024

For large request bodies, decryption/encryption might require running on a separate std thread and not a task

Status: Open.

#278 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 9, 2024

Oneshot receivers can potentially be bundled in futures unordered for stacking auth with inference

good first issueGood for newcomersGood for newcomers

Status: Open.

#277 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 8, 2024

Ciphertext byte arrays should be base64 encoded when served to the proxy

confidential-compute

Status: Open.

#276 In AtomaAI/atoma-node;

· jorgeantonio21 opened on Dec 7, 2024