Want this dataset evaluated?
Book a call to scope the analysis. The call decides whether measuring your search is worth it, and what the smallest useful first step is.
Opens our booking page on Calendly, a US service; it asks for your name and email. Prefer email? info@tensoropt.ai
Want a first look at the export yourself? The search log guide shows how to read it with the free jq tool.
Your dataset is still only on your machine
Exporting created a zip file on your side and sent nothing. The click that brought you here sent nothing about the dataset either. TensorOpt sees data only if you choose to share it after scoping, under a written agreement (a data processing agreement if the queries may contain personal data).
What the call covers
- The decision the evaluation should inform.
- What the export holds, judged from
manifest.json(event count, field coverage, dropped events) rather than the raw data. - Whether a Readout is worth it, and what you can do yourself if it is not.
What an evaluation needs from you
- The export, or a redacted subset of it.
- The configurations to compare, and a staging instance to run them on.
- A few hours of a domain expert's time to label results.
What you get back
A Readout is an independent reading of what the numbers in your export mean for your decision: what to measure first, a labelling plan sized for your case, and a fixed quote for an Evaluation. It comes as a short written report, with CSV files of the top and failing queries. An Evaluation measures one decision with the labels your experts produce, and you keep the judgment set.
What you already hold
events.jsonl: one search per line, with the query, filters and ranked results.manifest.json: coverage statistics and the settings in force.README.md: the schema and how to read it.
With default settings the plugin has the log ready after 30 days and 500 searches, keeps records for 90 days, and exports no raw user identifiers: each search carries only a salted hash that changes weekly. Query text is typed by your users and can still contain personal data. Check title and snippet coverage in the manifest before planning any labelling.
Next step: the Readout
The Readout tells you what the numbers mean for your decision, what to measure first, how to label (a plan sized for your case) and what the Evaluation costs (a fixed quote). EUR 2,000 fixed. The work takes one calendar week after your input arrives, runs asynchronously, and ends with one 30-minute walkthrough.
The input can be the plugin export, your own query log with the results shown, or, for systems without a usable log, 30 to 100 real questions written by your experts. From a log, a Readout needs no labelling; it plans the labelling for an Evaluation. From expert questions, each question needs the document that answers it.
Not ready to book? The search log guide covers what you can check yourself.