Archive

Page 6 of 11

Chain of Thought

Listed inChain of ThoughtPrompt Engineeringon

On models that reason by default, asking for step-by-step thinking pays for the steps twice. Carried-over verification instructions cause over-verification, and tag conventions are a weak way to separate reasoning from the answer.

Intermediate3 min
#prompting
#reasoning

Jina Embeddings

Listed inJina EmbeddingsEmbeddingson

A 32,768-token context means the encoder stops dictating your chunk size. Task types move the query-versus-passage distinction into a parameter a reviewer can see, and truncatable vectors have one way to cut them safely.

Intermediate3 min
#providers

Modus

Listed inModusAI Agentson

The repository is archived and read-only, last pushed in September 2025. The idea worth keeping is the sandboxed WebAssembly module, which bounds what an agent can touch in a way importing a library does not.

Intermediate3 min
#frameworks

Nano Banana API

Listed inNano Banana APIMultimodal AIon

The nickname is the documented product name for Gemini's native image generation. Multi-turn conversation is the recommended way to change an image, reference budgets are capped by category and in total, and every result carries a SynthID watermark.

Beginner3 min
#api

Meta Llama

Listed inMeta LlamaModels & Providerson

Downloadable weights come under a custom licence rather than Apache or MIT. It requires a "Built with Llama" notice, a model name beginning with Llama, and a separate agreement above 700 million monthly active users.

Intermediate3 min
#open-weights

Chroma

Listed inChromaVector Databaseson

The persistent client gets a working query with no infrastructure decision, and the collection code survives the move to a server. Concurrency, the directory's lifetime and backups are the bill that arrives with traffic.

Beginner3 min
#stores

Building an MCP Server

Listed inBuilding an MCP ServerModel Context Protocolon

The input schema tells the model what to send as well as validating what arrives. Returning tools in a stable order protects callers' prompt caches, and an error that names the rule lets the model correct itself.

Intermediate5 min
#implementation

Model-Based Evals

Listed inModel-Based EvalsEvaluationon

A judge answers what code cannot decide, and costs a model call per case while being able to be wrong. Validate it on ranking rather than absolute scores, and test it for grader hacking, position bias and verbosity bias.

Advanced4 min
#methods

Training

Listed inTrainingIntroductionon

Pre-training, post-training, and RLHF — the parts you rarely do but always need to reason about.

Intermediate7 minDraft
#concepts

Ollama

Listed inOllamaModels & Providerson

One command pulls a packaged build and serves it, which means a quantization was chosen for you. Compatible client surfaces let existing code point at it, and a single-user local runner is no evidence about serving traffic.

Beginner3 min
#local

Cost & Latency Monitoring

Listed inCost & Latency MonitoringObservabilityon

Output, cache reads, cache writes and batch requests are priced differently, so one token total cannot produce a bill. Record time to first token apart from total duration, and alert on ratios rather than on spend that grows with success.

Intermediate4 min
#practices
#cost