ONEENO / SOFTWARE & SYSTEMS

Under the hood.
Everything that makes your team work.

An assistant that calls, takes minutes, calculates and remembers needs a lot of technology. Some of it we build ourselves, some we buy from specialised parties. Here is the overview, per subject. Which parties we use, we discuss with you at installation.

256 components, 242 of which already work. Works In development Planned On request

Conversation and voice

Talking to your assistant as to a person: fast, natural, and she lets you finish.

Component	What it does	Standard	Status
Real-time speech-to-speech	Streaming voice in and voice out with low latency, so a conversation flows.	WebRTC · Opus	Works
Turn-taking model	Recognises when you have finished speaking, even with a pause mid-sentence.		Works
Voice activity detection (VAD)	Separates speech from silence and noise; background voices are ignored.	VAD	Works
Barge-in	You can interrupt her; she stops and listens.		Works
Echo and noise suppression	Audio processing in the app so she does not hear herself through the speaker.	AEC · NS (WebRTC)	Works
Expressive speech synthesis	A neural voice with intonation and directions (laughter, emphasis, pace).	neurale TTS	Works
Pronunciation dictionary	Jargon, names and abbreviations pronounced correctly, per field and per project.		Works
Speaking numbers	Phone numbers, amounts and dates sound the way a person says them.		Works
Multiple voices in one conversation	A second voice, for example a reporter for sports results.		Works
Voice choice	Choose a voice from a library of hundreds, or a voice designed for you.		Works
Your assistant’s own name	You choose her name; she responds to it.		Works
Voice cloning	A voice based on a recording, with the speaker’s consent.		Planned
Answers in parts	The gist first, the rest in the inbox; no long monologues.		Works
Adjustable tone and length	Formal or informal, short or extensive, per owner.		Works
Wake word while listening in	Say her name during a meeting and she responds without stopping the listening.		Works
Mode for noisy places	Louder and clearer in a café, on the street or in a full room.		Works
Situation recognition	Recognises whether you are in the car, in a meeting or on the street, and adapts tone and length.		Planned
On-device speaker verification	Only your voice can give her instructions; recognition runs on your phone.	cosinusgelijkenis van embeddings	In development
Speaker embeddings (neural network)	A voiceprint computed in the browser with a neural network (WebAssembly).	ONNX · WebAssembly	In development
Guest mode	Someone else may talk to her briefly, without access to your data.		Works
Earbuds and headsets	Works with wireless earbuds, also while driving.		Works
Typing and talking interchangeably	The same conversation by text or voice; switch without losing anything.		Works

Languages, interpreter and minutes

Speaking and understanding many languages, translating, and recording what was said.

Component	What it does	Standard	Status
Speaking 70+ languages	The voice can speak more than seventy languages.		Works
Understanding 90+ languages	Speech recognition and transcription in more than ninety languages.	ASR	Works
Automatic language detection	Detects by itself which language is spoken.		Works
Live interpreter	Listens in and translates into Dutch, on screen and aloud if you wish.		Works
Speaker separation (diarisation)	Who said what in a meeting with several people.	diarisatie	Works
Minutes and debrief	Minutes, decisions and action items with who and when, in your inbox afterwards.		Works
Tasks during a meeting	Give the team a question or task while she listens in.		Works
Jargon in two languages	Terms per field and per project, in Dutch and English, with explanations.		Works
Multilingual app and website	The app in Dutch and English; the website in Dutch, English and Spanish.		Works
Learning how you speak	She learns your way of saying things and checks once.		Works

Thinking: language models and reasoning

The engine behind your team: several models, each for what it does best.

Component	What it does	Standard	Status
Frontier reasoning model	The heaviest model for analysis, reports and deep thinking.		Works
Fast conversation model	A light model for the conversation itself, so she answers instantly.		Works
Multiple providers	Models from different providers, chosen per task.		Works
European fallback model	If a provider fails, another model takes over the thinking, including a European one.		In development
Uniform model interface	One interface for several models; switching without rebuilding.	OpenAI-compatibele chat-API	Works
Router: intent recognition	Recognises what you mean and picks the right route, team member and model.		Works
Hybrid language understanding	Fixed patterns for speed, a language model when it is unclear.		Works
Understanding within small sets	Picks from your conversations, contacts or cards what you mean, even if you don’t say it literally.		Works
Thinking levels	Quick, standard, thorough or research; set per question or per team member.		Works
Agentic research	Searches the web for sources, reads and weighs them, with citations.	web search · tool use	Works
Tool use	The model calls functions: calendar, documents, calling, search.	function calling	Works
Structured output	Answers in a fixed schema (JSON), so the app processes them reliably.	JSON Schema	Works
Image understanding (multimodal)	Understanding photos and screenshots: what is this, what does it say.		Works
Prompt caching	Stable knowledge up front and reused: faster and cheaper.	prompt cache	Works
Batch processing	Large reading rounds in one go, outside the conversation, within a budget.	batch-API	Works
Cost monitoring	Usage measured per task and per month, with a ceiling.		Works
Counter-argument	A critic who looks for weak points before you decide.		Works
Honest about uncertainty	Fact, assumption and hypothesis are kept apart; no invented sources.		Works

The team: members, specialists and playbooks

Your assistant has a team behind her, each with their own field, method and bar.

Component	What it does	Status
Personal team	Concierge, travel concierge, scouts, receptionist, minute-taker and more.	Works
Business team	CFO, lawyer, tax adviser, strategist, marketer, researcher, critic, business developer, CTO and more.	Works
Work instructions per member	Method per type of task, the bar for good work, and examples.	Works
Version-controlled prompts	Each member’s fixed prompts are version-controlled and tested.	Works
Address a member by name	“CFO, have a look”: you address a team member directly.	Works
The round	Several specialists on one question at once, each from their field.	Works
Field view per project	Each member knows your project through their own lens, with sources.	Works
Trial per member	Fixed test questions, judged by a second model; measured before and after every change.	Works
Measured against exams	The model class is tested on exams such as CFA, bar exam and science tests.	Works
Playbooks	Fixed methods for recurring matters: restaurants, sport, tickets, travel.	Works
Intake per playbook	A short conversation that tunes the playbook to you.	Works
Custom specialist	A team member for your field or sector, set up together: three with Executive and ten with Signature included, chosen from fifty or made to measure.	Works
Engine room	Team members working behind the scenes: memory, quality, learning.	Works

Tailored: settings and character

Not a standard assistant: you set how your team works, and that may change tomorrow.

Component	What it does	Status
Settings per member	Sliders, choices, lists and free text, with a default per edition.	Works
Order of work	Where a member starts and what weighs most.	Works
Sources and exclusions	Where he looks, and where he deliberately doesn’t.	Works
Guardrails	What a member always or never does for you.	Works
Attitude	Strict or pragmatic, cautious or ambitious.	Works
Delivery format	Short answer, memo, presentation outline or report.	Works
Your assistant’s character	Name, voice, tone and form of address.	Works
Set by saying it	“From now on …” becomes a rule she remembers and applies.	Works
Settings book	Per member the intake questions for installation, per edition.	Works
Work profile	Lessons for your type of work, shared with owners in the same field.	Works

Memory and knowledge

She remembers what matters, finds it again, and says where it came from.

Component	What it does	Status
Conversation memory	Continue where you left off, with time windows as people name them.	Works
Personal profile in levels	She gets to know you at the level you choose; sensitive facts are not stored.	Works
Preferences and agreements	What you do and don’t want, and what you agreed.	Works
Project file	Everything known and decided about a project, in one place.	Works
Your own CRM	One card per person, all sources merged.	Works
Importing your network	Contacts from your phone and your professional network, merged without duplicates.	Works
Places and visits	Restaurants, clubs and addresses you know, with your verdict.	Works
Knowledge around your interests	Per interest a knowledge table with sources, kept up to date by scouts.	Works
Promise tracking	What she promises in a conversation is checked afterwards.	Works
Occasions and expiring papers	Birthdays, anniversaries, passport, licence, MOT and insurance on time.	Works
Finding with source	Finding an appointment or fact, with where it was.	Works

Learning and quality

A team that gets better every week, and measures whether it does.

Component	What it does	Status
Learning loop	Every error becomes a test case, a repair and a lesson.	Works
Lessons in three layers	For everyone, per field of work, and only for you.	Works
Remembering corrections	Correct her, and she applies it from then on.	Works
Golden set	Hundreds of real sentences with the expected route, as a fixed test.	Works
Routing score as a gate	A change only goes live if the score does not drop.	Works
Quality controller	A team member who checks the work of the others.	Works
Shared learning without private data	What helps everyone is shared, without content or personal data.	Works
Measurements without content	Types and counts, never what you said.	Works
Passing on improvements	A wish beyond your settings goes to the product team.	Works
She tests herself	A test round every day; anything red becomes an incident the same day.	Works

Telephony

She calls for you, joins your calls, and listens in when you want.

Component	What it does	Standard	Status
Outbound calls on your behalf	A voice agent calls restaurants, practices and others with your instructions.		Works
Booking by phone	Arranging a table or appointment by phone, with a report back.		Works
Calling with a message	Calling someone to pass on a message.		Works
Voicemail detection	Recognises voicemail and leaves a fitting message.		Works
Joining your call	She joins a call you are having.		Works
Conference bridging	Several participants in one call, merged.	conference bridge	Works
Call recording with consent	Recording a call in both directions, for the minutes.	opname, twee kanalen	Works
Listening line	Call a number and Bloem listens in to a call already in progress.		In development
Own call-back number	A fixed number on which your assistant can be called back.		In development
Multiple phone lines	Several numbers at once, for example business and private.		Planned
Calling window and rules	When she may call, whom, and in what tone.		Works
Phone network and VoIP	Regular phone numbers (PSTN) linked to voice over the internet.	PSTN · SIP · VoIP	Works

Calendar, mail and messages

Appointments, invitations and messages, without you opening a screen.

Component	What it does	Standard	Status
Calendar management	Reading, planning and moving appointments in your calendar.		Works
Invitations with guests	Creating an appointment and inviting the guests.		Works
Combining appointments	“You’re there anyway”: combining appointments in the same area.		Works
Delegated authorisation (OAuth 2.0)	Access to your calendar without sharing your password, revocable at any time.	OAuth 2.0 · authorization code · refresh token	Works
Your assistant’s own e-mail address	Sending what you approve, receiving what you forward.		Works
Forwarding mail to a project	Forward an e-mail and it lands with the right project.		Works
Push notifications	Notifications on your phone when something is ready or needs attention (Web Push).	Web Push · VAPID	Works
Sharing via the share sheet	Send anything to your assistant from any app, including messaging apps and AirDrop.	Web Share Target	Works
Forwarding as PDF or text	Forward a message from your inbox by e-mail or messaging app.		Works
Inbox with evidence	Everything your team did is in your inbox, with source and date.		Works
Task list	Tasks from your conversations, with what awaits your approval.		Works

Documents and office files

Reading, writing and editing in the formats you work in.

Component	What it does	Standard	Status
Reading text documents	Word documents, including long contracts, down to the paragraph.	DOCX (Office Open XML)	Works
Reading PDF	Page by page, with the page as source.	PDF	Works
Reading spreadsheets	Sheets, formulas and tables in Excel files.	XLSX (Office Open XML)	Works
Reading presentations	Slide by slide, with the slide as source.	PPTX (Office Open XML)	Works
Markdown, CSV and plain text	Notes, exports and lists.	Markdown · CSV · UTF-8	Works
Creating PDF reports	Reports and business plans as one PDF, with a table of contents.	PDF	Works
Creating and updating models	A new version of your Excel model next to the original.	XLSX	Works
Charts	Charts with figures, on request.		Works
Creating presentations	A PowerPoint with slides, speaker notes and tables, made by the team.	PPTX (Office Open XML) · 16:9	Works
Reading aloud in parts	Reading a document aloud, in bite-sized parts.		Works
Questions down to detail	A question about a document, with the answer and where it is.		Works
Text from photos	Reading text from photos, receipts, business cards and letters.	OCR (multimodaal model)	Works
Receipts and expenses	A photo of a receipt becomes an expense line.		Works
Importing chat exports	Adding an exported message conversation to a project.		Works
Letters and objections	From a photo of a fine to a letter ready to send.		Works
Counter-check before signing	Reviewing a contract or proposal for risks.		Works

Browser and web services

She works on websites the way you do: searching, comparing, preparing.

Component	What it does	Standard	Status
Browser automation	An automated browser that visits websites, reads them and fills in forms.	headless Chromium · DOM-automatisering	Works
Browser on your own computer	For sites that refuse servers, she works through the browser on your laptop.		Works
Storing logins securely	For sites where you have an account, stored encrypted.	AES-256-GCM	Works
Fetching and reading pages	Give a link and she reads what it says.		Works
Courts, tee times, tickets	Searching and preparing at clubs and ticket sellers.		Works
Groceries	Ordering a shopping list at the supermarket.		In development
Researching trips	Researching and preparing a trip from A to Z.		Works
Never paying herself	She prepares; you pay and send.		Works

Integrations (APIs)

Your team talks to other systems, and an integration can be added per service.

Component	What it does	Standard	Status
REST and JSON integrations	The standard way systems exchange data.	REST · JSON · HTTPS	Works
Webhooks	Another system reports immediately when something happens.	HTTP callbacks	Works
Trade register	Looking up company data in the official register.		Works
Weather and travel time	Weather and travel time for an appointment or activity.		Works
Sports results	Results and fixtures of what you follow.		Works
News and trade sources	Scouts follow the sources you choose.		Works
Paid databases	Legal and business databases you subscribe to.		On request
Accounting software	Figures straight from your accounts for the CFO.		On request
CRM and project software	Integrations with the systems your company already uses.		On request
Extensible per service	Each new service gets its own integration, without touching the rest.		Works
Payments (website)	Online reservation with a deposit through a payment provider.	iDEAL · webhook	Works

Projects, files and versions

Your team knows your projects and sees what changed.

Component	What it does	Standard	Status
Reading project folders	Your own folders on your laptop remain the working copy.		Works
Read-only mirrors	A copy per project on the server that can only be read.	git over SSH	Works
Version history	Every previous version of a document remains visible.	git	Works
What changed	She reads the version history and tells you what changed.	git log · diff	Works
Automatic synchronisation	Updated every few minutes, without you doing anything.		Works
Adding to a project	Documents from others to the right project, from the app or your phone.		Works
Project front to back	Reading and understanding a whole project before working on it.		Works
Access per project	Per project you decide what your team may read; forbidden folders stay closed.		Works

Infrastructure and hosting

Where it runs, and why it keeps running.

Component	What it does	Standard	Status
European servers	Your data is on a server in the European Union.	EU-datacenter	Works
Own server per customer	Each customer their own, shielded environment.		Works
Server size of your choice	Computing power and storage to fit your use, scalable.		Works
Containers	Each component in its own container: reproducible and quick to restore.	OCI-containers · Compose	Works
Linux	The server’s operating system.	Linux LTS	Works
Encrypted tunnel	The server is reachable without open ports to the internet.	uitgaande tunnel · mTLS	Works
Global edge network	The website is served close to the visitor, with attack protection.	CDN · DDoS-bescherming	Works
Serverless functions	Forms and payments on the website run without a server of their own.	edge workers	Works
Job queue	Work continues in the background, even after you hang up.	job queue	Works
Scheduled night rounds	Scouts and maintenance run at night.		Works
Health checks	The server checks itself and reports problems.	health check	Works
Connection with your laptop	A secured connection with heartbeat, for files and the browser on your laptop.	long-poll · heartbeat	Works

Security and privacy

Your data is yours, and that is how it is built.

Component	What it does	Standard	Status
Encrypted traffic (TLS)	All connections encrypted, from app to server.	TLS 1.3 · HTTPS	Works
Password protection	Passwords are never stored readable, only as a derived key (PBKDF2-SHA256).	PBKDF2-HMAC-SHA256 · 600.000 rondes	Works
Signed tokens (HMAC)	Access tokens with a signature, so they cannot be forged.	HMAC-SHA256	Works
Device keys	Each device its own key, revocable per device.	HMAC-SHA256 · intrekbaar	Works
SSH keys	Server administration only with keys, no passwords.	SSH · Ed25519	Works
Read-only keys per project	Each project copy has its own key that may only read.	SSH deploy keys	Works
Roles and permission levels	What may happen without asking, what needs your approval, what never.		Works
Secrets in your vault	Keys are in the server configuration and your password vault, never in the code.		Works
Audit log	Every action is recorded: what, when and with what result.	append-only log	Works
Request trace	What happened per request can be traced, for fast troubleshooting.		Works
Sensitivity rules	Sensitive topics and data get an extra threshold.		Works
Data minimisation	Improvement data only as types and counts, never content.		Works
She never sends or pays herself	Every outward action only happens after your approval.		Works
Voice guard	Only your voice can give her instructions.		In development

Backup, continuity and portability

Nothing you build depends on one machine or one supplier.

Component	What it does	Standard	Status
Daily backup	Every morning a fresh backup of everything your assistant knows.		Works
Three layers	On the server, on your laptop and encrypted in your own cloud storage.		Works
Encrypted copy (AES-256-GCM)	The copy outside the server is unreadable without your key.	AES-256-GCM · HKDF-SHA256	Works
Daily test restore	Every day a backup is restored into an empty test environment.		Works
Settings without secrets	All settings saved daily, without passwords.		Works
Everything can be restored	Every software version is tagged; rolling back is always possible.		Works
Open formats	Your data in standard formats (SQL database, JSON, Markdown), readable without us.	SQLite · JSON · Markdown	Works
Handover file	Every setting, permission and method described, for handover.		Works
Transferable team book	Each member’s intelligence and lessons are transferable, without private data.		Works
Outage-resistant thinking	If a provider fails, another takes over.		Works

App and devices

One app on your phone and your computer.

Component	What it does	Standard	Status
Installable web app (PWA)	On your home screen like a regular app, without an app store.	PWA · Web App Manifest	Works
Service worker	Fast loading and a clear message when there is briefly no connection.	Service Worker API	Works
Light and dark theme	Follows your phone or your choice.		Works
Camera and photos	Give your assistant a photo: what is it, what do you want with it?		Works
Business cards and QR codes	Scan a card, show your own card as a QR code.	QR (ISO/IEC 18004)	Works
Contact card (vCard)	Your assistant in your contacts, with her own card.	vCard	Works
Workspace per task	Conversation, result and progress of a running task.		Works
Usage overview	What your assistant costs, per month and per type of work.		Works
Works on phone and computer	The same app on every screen.		Works

Software, languages and standards

What it is made of.

Component	What it does	Standard	Status
Python	The server language: the brain, the integrations and the team.	Python 3	Works
JavaScript	The language of the app on your phone.	ECMAScript	Works
TypeScript and React	The website.	TypeScript · React	Works
HTML and CSS	Layout and design of app and website.		Works
SQL	The database with everything your assistant knows.	SQLite	Works
Shell scripts	Deployment, backup and maintenance, automated.	Bash · PowerShell	Works
Asynchronous web server (ASGI)	Many requests at once, without waiting.	ASGI	Works
JSON and Markdown	Structured data and readable texts.		Works
WebRTC and WebSocket	Real-time audio and messages between app and server.	WebRTC · WebSocket	Works
WebAssembly and ONNX	Neural networks running in the browser, on your own device.	WASM · ONNX Runtime	In development
OAuth 2.0 and OpenID	Signing in and granting access without sharing passwords.	OAuth 2.0 · OpenID Connect	Works
Web Push with VAPID	Notifications to your phone, with their own key pair.	RFC 8030 · RFC 8291 · RFC 8292	Works
Structured data (schema.org)	Search engines and AI models understand the website and the film.	schema.org · JSON-LD	Works
Version control	Every change kept, with who, when and why.	git	Works

Cryptography and protocols

Which encryption and which keys are used where. Deliberately without version numbers, addresses or key locations.

Component	What it does	Standard	Status
Transport encryption	All traffic between app, website and server encrypted.	TLS 1.3	Works
Mutually authenticated tunnel	The server makes its own outbound, encrypted connection; no ports are open.	mTLS · uitgaand	Works
Password hashing	600,000 rounds with a random 128-bit salt per password; older hashes are upgraded at login.	PBKDF2-HMAC-SHA256 · 600k · 128-bit salt	Works
Constant-time comparison	Keys and hashes are compared without the duration revealing anything.	constant-time compare	Works
Signed session tokens	Access tokens with a signature, an expiry time and a hashed user.	HMAC-SHA256 · exp	Works
Cryptographically secure randomness	Salts, keys and tokens come from a cryptographically secure generator.	CSPRNG	Works
Vault for logins	Website passwords stored encrypted, with a key only the server knows.	AES-256-GCM · gebonden aan de site	Works
Encrypted backup	Authenticated encryption with a 256-bit key, derived with a key derivation function, and a unique nonce per file.	AES-256-GCM · HKDF-SHA256 · 96-bit nonce	Works
Key-based server administration	Signing in to the server only with a key pair.	SSH · Ed25519	Works
Read-only keys per repository	Each project copy has its own key that may only read.	SSH deploy keys (read-only)	Works
Encrypted push notifications	The content of a notification is encrypted for your device; the sender proves itself with its own key pair.	VAPID ES256 · ECDH P-256 · aes128gcm	Works
Real-time voice encrypted	Audio between app and voice service encrypted, including the media stream.	DTLS-SRTP	Works
Signed telephony callbacks	Every callback from the telephony platform is checked on its signature.	HMAC-handtekening	Works
Payment status at the source	A payment notification is not trusted but checked with the payment service.	server-side verificatie	Works
Delegated access	Access to calendar and accounts without a password, limited to what is needed, revocable.	OAuth 2.0 · scopes	Works
Secrets outside the code	Keys in protected configuration files and the owner’s vault; never in code or logs.	environment · 0600	Works

API structure

How the components talk to each other and to other systems, and how an integration is added.

Component	What it does	Standard	Status
REST over HTTPS	Every function is a fixed address with a clear request and a JSON response.	REST · JSON · HTTPS	Works
Described schema	The interfaces are recorded in a machine-readable schema.	OpenAPI	Works
Token authentication	Every call carries a signed token; no token, no access.	Bearer · HMAC-SHA256	Works
Asynchronous jobs	Task in, job number back, follow the status (queued, running, done, failed), result in the inbox.	job-ID · status · polling	Works
Incoming webhooks	Other systems report events; the signature or the source is verified.	webhooks · signature	Works
Real-time channels	Voice and events live between app and server.	WebRTC · WebSocket	Works
Connection with heartbeat	The laptop keeps a connection open with a heartbeat and asks for work itself.	long-poll · heartbeat	Works
Function calls with fixed schemas	The language model calls functions with parameters in a fixed schema.	function calling · JSON Schema	Works
Uniform chat interface for models	One interface for models from several providers, so switching is a setting.	OpenAI-compatibel	Works
Adapter per service	Every external service has its own adapter; a new integration does not touch the rest.	adapterpatroon	Works
Retries and fallback	On an error or time-out, try again, then another route.	retry · backoff · fallback	Works
Serverless edge functions	Forms, payments and video on the website as functions at the edge of the network.	edge workers	Works
Video in ranges	Video delivered in parts at the player’s request, so every phone can play and seek.	HTTP Range · 206 Partial Content	Works

Testing, measuring and release

A new version only goes live when everything is green.

Component	What it does	Standard	Status
Automated tests	Thousands of checks on every component, before every release.		Works
Canary tests after release	Right after a release a series of real questions; automatic rollback on red.		Works
Interface explorer	A program that clicks through the app by itself looking for errors.		Works
Voice and browser tests	Weekly with a real voice and a real browser.		Works
Daily test question	Every morning one field test from the test playbook.		Works
Field-test tracking	Per function tracked whether it is proven in practice.		Works
Release tags	Every live version gets a tag, so rolling back is always possible.	git tags	Works
Weekly measurements	How often, how fast and how well, without content.		Works

Under the hood. Everything that makes your team work.