Now booking: Pakistan Regional Voice Evaluation pilots for Q1 2027→
Speech evaluation · Underserved languages

Real speech.
Measurable AI performance.

Human-verified speech data and independent voice AI evaluation for Saraiki, Pakistani Punjabi and Urdu, recorded with consent in real homes, markets and fields.

Built for teams shippingSpeech recognitionText-to-speechVoice agentsMultilingual LLMsContact-centre AI
EVAL REPORT · clip 0041
Verified transcript✓ 2 native reviewers

ASR model outputmodel withheld

Meaning

words wrong
main error class
meaning kept
Illustrative example of our report format. Live consented samples publish at launch.
0.03%

of web addresses in Common Crawl's July 2026 collection were Urdu, for a language spoken by well over 200 million people.

Source: World Bank figures via K. Zafar, Oct 2026
$1B

national AI programme in Pakistan, including a sovereign multilingual model that will need local-language speech and text.

Source: K. Zafar, Oct 2026
$16.3B

projected AI training dataset market by 2034, up from $3.2B in 2024 (20.5% CAGR).

Source: Global Market Insights
Language atlas

Where our voices come from

Every recording is tied to a district, a dialect and a signed consent. Select a district to see what we collect there.

Pilot network formingPlanned
اساں گھر ونجنا اے

"Assaan ghar wanjna ae": "We have to go home" in Saraiki. Tens of millions speak it, yet written Saraiki barely exists online, so models trained on Urdu text turn it into Urdu.

What we deliver

Three ways AI teams work with us

Start with one pilot. Most teams add collection and monthly regression testing once they see the first report.

01 · Evaluation

Independent voice AI evaluation

We test your ASR, TTS or voice agent on speech it has never heard and show exactly where it breaks.

  • Error taxonomy per utterance
  • Dialect, noise and code-switch splits
  • Re-test on every model release
Explore evaluation →
02 · Collection

Custom speech collection

Scripted or natural conversation recorded to your spec, with speaker demographics and recording conditions logged.

  • Consent and licence per speaker
  • Rural, urban and phone-line audio
  • Delivered with verified transcripts
Explore collection →
03 · Labelling

Human-labelled training data

Native-speaker transcription, translation and LLM response rating for languages your vendors can't staff.

  • Double review, disagreement logged
  • Style guides per dialect
  • Secure, access-controlled delivery
Explore annotation →
Evaluation lab

The failures generic benchmarks miss

We report errors by cause, so your team knows what to fix first instead of staring at one average score.

How a pilot works

From scope to report in three weeks

A fixed-scope pilot of 100 consented utterances. You see our quality before any larger commitment.

WEEK 1Scope

Choose languages, recording conditions and the model or API to test.

WEEK 2Record and verify

Consented speakers recorded; every reference checked by two reviewers.

WEEK 3Report

Error classes, examples and priorities, delivered with all raw files.

MONTHLYRegression

The same private test set on each new model version.

Method

From a village courtyard to a clean dataset

  1. RecruitLocal coordinators find speakers by district, age and dialect.
  2. ConsentPurpose explained in the speaker's own language, then signed.
  3. RecordPhone and studio-grade devices; conditions logged per clip.
  4. TranscribeA native transcriber writes the reference text.
  5. ReviewA second reviewer checks; disagreements are resolved and logged.
  6. DeliverAudio, transcripts, metadata and a licence file.
Consent and governance

Consent is part of the product

Explained in their language

Every speaker hears what the recording is for in Saraiki, Punjabi or Urdu before signing.

Paid on the day

Speakers are paid for their time. No recording without payment.

Clear licence

Each dataset ships with a licence file, speaker metadata and provenance record.

Private test sets

Evaluation audio is never published, so your scores stay meaningful.

Access-controlled delivery

Files shared through restricted links with access logs; NDA available.

Withdrawal process

Speakers can ask for future use of their voice to stop; we track it per clip.

Insights

What we are learning in the field

Practical notes for speech and LLM teams working on South Asian languages.

FAQ

Questions AI teams ask us

Which languages do you cover today?

We launch with Saraiki, Pakistani Punjabi and Urdu, including Urdu–English code-switching. Sindhi and Pashto come next, then Balochi. We mark a language live only when we have verified speakers and reviewers for it.

How is this different from Indian Punjabi or Urdu datasets?

Pakistani Punjabi and Saraiki differ in vocabulary, script, accent and everyday code-switching. We record in Pakistani districts with local speakers, so the audio matches what your users in Pakistan and its diaspora actually say.

What do we receive from a pilot?

100 consented utterances, verified reference transcripts, your model's outputs, an error report grouped by cause, speaker metadata and a licence file.

Can you test our model through an API?

Yes. Give us test access to your API or upload outputs yourself. We never use your model outputs or evaluation results for anyone else.

Who owns the recordings?

For custom collection, you receive a licence suited to your use, agreed before recording starts and explained to every speaker. Evaluation test sets stay private by default.

Start small

Test your model on 100 real utterances.

A fixed-scope pilot across Saraiki, Pakistani Punjabi and Urdu with a full error report. You keep the findings.