Experiments
Numbered experiments: hypothesis, setup, result, conclusion. No invented benchmarks.
- Is conversation history a memory system? — Treating the full transcript as memory versus storing task state.
- Should the model compute, or should code compute? — Internal model arithmetic versus plan-then-execute on spreadsheet-like tasks.
- Can an LLM own the entire quoting workflow? — End-to-end generation versus interpretation plus deterministic pricing in QuoteSnap AI.
- Can downstream software consume unconstrained prose? — Natural-language job summaries versus validated structured signals before pricing.
- Can the context window stand in for the repository? — Observational study of coding agents on codebases larger than the window.
- Is semantic similarity enough to find the controlling code? — Authentication-style queries retrieve related UI and still miss middleware and policy.
- What changes if I stop treating the LLM as an API? — Hands-on model work: data, tokens, embeddings, attention, inference, and serving constraints.
- Does re-explaining the project every turn work? — Repeated briefing versus persistent rules, files, and task-scoped chats.
- Is code generation enough without a run loop? — Generate-once versus generate, run, inspect, and repair inside an environment.
- Do vague requests produce useful coding-agent behaviour? — Unspecified “vibe” prompts versus task-first requirements, conventions, and expected behaviour.
- Should a coding agent live in one endless chat? — Long sessions versus a new chat per task, with bugs written as tasks.
- Should the agent start from a blank repository? — Greenfield generation versus a TypeScript boilerplate that already encodes product decisions.
This archive contains independent research, experiments, architecture studies, and technical observations. Some findings are exploratory and should not be interpreted as peer-reviewed scientific conclusions unless explicitly stated. Architecture studies of third-party products are based on publicly observable behaviour, published technical information, and engineering analysis. They are not claims of access to private source code or infrastructure.