HorizonIQHow accurate is HorizonIQ?
We ask HorizonIQ real questions through the same connector AI assistants use, and check every answer against the publisher's own numbers, downloaded and computed separately. Every question, answer and result is listed below.
113 of 113correct (100.0%)
42 / 42Latest values
28 / 28Calculations
28 / 28Local markets
15 / 15Guardrails
Run 2026-10-23 11:26 UTC. 0 question(s) not run.
Method and code: evals/accuracy.py. Raw results: JSON.
Latest published values
The newest value equals the publisher's number for that period, and that period is the publisher's newest.
| # | Question | HorizonIQ | Expected | Result |
|---|---|---|---|---|
| V01 | What is the latest US consumer price index (CPI-U, all items)? US Bureau of Labor Statistics (US Dept. of Labor) |
336.94 (2026-09-01) | 336.94 (2026-09-01) | Correct |
| V02 | What is the latest core CPI (all items less food and energy)? US Bureau of Labor Statistics (US Dept. of Labor) |
339.287 (2026-09-01) | 339.287 (2026-09-01) | Correct |
| V03 | What is the latest CPI for groceries (food at home)? US Bureau of Labor Statistics (US Dept. of Labor) |
321.758 (2026-09-01) | 321.758 (2026-09-01) | Correct |
| V04 | What is the latest CPI for restaurant meals (food away from home)? US Bureau of Labor Statistics (US Dept. of Labor) |
398.783 (2026-09-01) | 398.783 (2026-09-01) | Correct |
| V05 | What is the latest CPI for limited-service (fast food and counter-service) meals? US Bureau of Labor Statistics (US Dept. of Labor) |
260.209 (2026-09-01) | 260.209 (2026-09-01) | Correct |
| V06 | What is the latest CPI for full-service restaurant meals? US Bureau of Labor Statistics (US Dept. of Labor) |
246.898 (2026-09-01) | 246.898 (2026-09-01) | Correct |
| V07 | What is the latest CPI for alcoholic drinks bought away from home? US Bureau of Labor Statistics (US Dept. of Labor) |
458.827 (2026-09-01) | 458.827 (2026-09-01) | Correct |
| V08 | What is the latest CPI for eggs? US Bureau of Labor Statistics (US Dept. of Labor) |
279.288 (2026-09-01) | 279.288 (2026-09-01) | Correct |
| V09 | What is the latest CPI for coffee? US Bureau of Labor Statistics (US Dept. of Labor) |
299.101 (2026-09-01) | 299.101 (2026-09-01) | Correct |
| V10 | What is the latest CPI for beef and veal? US Bureau of Labor Statistics (US Dept. of Labor) |
512.606 (2026-09-01) | 512.606 (2026-09-01) | Correct |
| V11 | What is the latest CPI for shelter? US Bureau of Labor Statistics (US Dept. of Labor) |
432.092 (2026-09-01) | 432.092 (2026-09-01) | Correct |
| V12 | What is the latest producer price index for final demand? US Bureau of Labor Statistics (US Dept. of Labor) |
159.613 (2026-09-01) | 159.613 (2026-09-01) | Correct |
| V13 | What is the latest producer price index for processed foods and feeds? US Bureau of Labor Statistics (US Dept. of Labor) |
276.68 (2026-09-01) | 276.68 (2026-09-01) | Correct |
| V14 | What is the latest producer price index for truckload freight? US Bureau of Labor Statistics (US Dept. of Labor) |
219.384 (2026-09-01) | 219.384 (2026-09-01) | Correct |
| V15 | How many people are on US nonfarm payrolls? US Bureau of Labor Statistics (US Dept. of Labor) |
159044 (2026-09-01) | 159044 (2026-09-01) | Correct |
| V16 | What is the US unemployment rate? US Bureau of Labor Statistics (US Dept. of Labor) |
4.2 (2026-09-01) | 4.2 (2026-09-01) | Correct |
| V17 | What is the average hourly wage in restaurants and bars? US Bureau of Labor Statistics (US Dept. of Labor) |
22.17 (2026-08-01) | 22.17 (2026-08-01) | Correct |
| V18 | What are average hourly earnings for private-sector workers? US Bureau of Labor Statistics (US Dept. of Labor) |
37.81 (2026-09-01) | 37.81 (2026-09-01) | Correct |
| V19 | What were US retail sales excluding food services last month? US Census Bureau (Economic Indicators) |
652115 (2026-09-01) | 652115 (2026-09-01) | Correct |
| V20 | What were US restaurant and bar sales last month? US Census Bureau (Economic Indicators) |
92906 (2026-09-01) | 92906 (2026-09-01) | Correct |
| V21 | What were US grocery store sales last month? US Census Bureau (Economic Indicators) |
77152 (2026-09-01) | 77152 (2026-09-01) | Correct |
| V22 | How many housing starts were there (annual rate)? US Census Bureau (Economic Indicators) |
1221 (2026-09-01) | 1221 (2026-09-01) | Correct |
| V23 | How many building permits were issued (annual rate)? US Census Bureau (Economic Indicators) |
1400 (2026-09-01) | 1400 (2026-09-01) | Correct |
| V24 | How many new homes were sold (annual rate)? US Census Bureau (Economic Indicators) |
684 (2026-08-01) | 684 (2026-08-01) | Correct |
| V25 | What is the effective federal funds rate? Federal Reserve Bank of New York |
3.88 (2026-10-21) | 3.88 (2026-10-21) | Correct |
| V26 | What is SOFR today? Federal Reserve Bank of New York |
3.88 (2026-10-21) | 3.88 (2026-10-21) | Correct |
| V27 | What is the average US retail diesel price? US Energy Information Administration |
6.276 (2026-10-19) | 6.276 (2026-10-19) | Correct |
| V28 | What is the WTI crude oil spot price? US Energy Information Administration |
107.89 (2026-10-20) | 107.89 (2026-10-20) | Correct |
| V29 | What is the average US retail gasoline price? US Energy Information Administration |
4.424 (2026-10-19) | 4.424 (2026-10-19) | Correct |
| V30 | What is the latest industrial production index? Board of Governors of the Federal Reserve System |
103.951 (2026-09-01) | 103.951 (2026-09-01) | Correct |
| V31 | What is the latest FHFA house price index? Federal Housing Finance Agency |
443.52 (2026-07-01) | 443.52 (2026-07-01) | Correct |
| V32 | How much total public debt does the US have outstanding? US Department of the Treasury (Fiscal Data) |
40.4136 (2026-10-21) | 40.4136 (2026-10-21) | Correct |
| V33 | How many initial unemployment claims were filed last week? US Dept. of Labor, Employment & Training Administration (ETA 539) |
191033 (2026-10-10) | 191033 (2026-10-10) | Correct |
| V34 | What is the US personal saving rate? US Bureau of Economic Analysis |
4.1 (2026-08-01) | 4.1 (2026-08-01) | Correct |
| V35 | What is the 10-year Treasury yield? US Treasury |
4.96 (2026-10-22) | 4.96 (2026-10-22) | Correct |
| V36 | What share of US retail sales is e-commerce? US Census Bureau (Quarterly E-Commerce Report) |
17.1 (2026-04-01) | 17.1 (2026-04-01) | Correct |
| V37 | How much did Americans spend online last quarter? US Census Bureau (Quarterly E-Commerce Report) |
340244 (2026-04-01) | 340244 (2026-04-01) | Correct |
| V38 | What were US clothing and accessories store sales last month? US Census Bureau (Economic Indicators) |
26478 (2026-09-01) | 26478 (2026-09-01) | Correct |
| V39 | What were sales of online-first (electronic shopping) retailers? US Census Bureau (Economic Indicators) |
116650 (2026-08-01) | 116650 (2026-08-01) | Correct |
| V40 | What is the latest producer price index for couriers and express delivery? US Bureau of Labor Statistics (US Dept. of Labor) |
400.821 (2026-09-01) | 400.821 (2026-09-01) | Correct |
| V41 | What does regular gasoline cost in California this week? EIA weekly retail gasoline by area |
6.031 (2026-10-19) | 6.031 (2026-10-19) | Correct |
| V42 | What did regular gasoline cost in the Atlanta metro area last month? BLS average price data |
4.023 (2026-09-01) | 4.023 (2026-09-01) | Correct |
Calculations
Year-over-year changes, monthly changes, spreads, today's-dollar values and the restaurant cost-price gap, recomputed from the publishers' numbers.
| # | Question | HorizonIQ | Expected | Result |
|---|---|---|---|---|
| C01 | What is headline inflation year over year? computed from the publisher's index values |
3.738 | 3.738 | Correct
2025-09-01 to 2026-09-01 |
| C02 | What is core inflation year over year? computed from the publisher's index values |
2.564 | 2.564 | Correct
2025-09-01 to 2026-09-01 |
| C03 | What is grocery inflation year over year? computed from the publisher's index values |
1.809 | 1.809 | Correct
2025-09-01 to 2026-09-01 |
| C04 | What is restaurant menu inflation year over year? computed from the publisher's index values |
3.459 | 3.459 | Correct
2025-09-01 to 2026-09-01 |
| C05 | What is fast-food price inflation year over year? computed from the publisher's index values |
3.188 | 3.188 | Correct
2025-09-01 to 2026-09-01 |
| C06 | What is sit-down restaurant price inflation year over year? computed from the publisher's index values |
3.766 | 3.766 | Correct
2025-09-01 to 2026-09-01 |
| C07 | What is inflation in drink prices at bars and restaurants year over year? computed from the publisher's index values |
2.623 | 2.623 | Correct
2025-09-01 to 2026-09-01 |
| C08 | What is egg price inflation year over year? computed from the publisher's index values |
-20.588 | -20.588 | Correct
2025-09-01 to 2026-09-01 |
| C09 | What is food manufacturers' price inflation year over year? computed from the publisher's index values |
-0.863 | -0.863 | Correct
2025-09-01 to 2026-09-01 |
| C10 | What is producer price inflation year over year? computed from the publisher's index values |
6.338 | 6.338 | Correct
2025-09-01 to 2026-09-01 |
| C11 | What is restaurant wage growth year over year? computed from the publisher's index values |
4.329 | 4.329 | Correct
2025-08-01 to 2026-08-01 |
| C12 | How much did restaurant and bar sales change from a year earlier? computed from publisher values |
6.989 | 6.989 | Correct
2025-09-01 to 2026-09-01 |
| C13 | How much did grocery store sales change from a year earlier? computed from publisher values |
0.913 | 0.913 | Correct
2025-09-01 to 2026-09-01 |
| C14 | How much did retail sales excluding food services change from a year earlier? computed from publisher values |
6.188 | 6.188 | Correct
2025-09-01 to 2026-09-01 |
| C15 | How much did the diesel price change from a year earlier? computed from publisher values |
73.37 | 73.37 | Correct
2025-10-20 to 2026-10-19 |
| C16 | How much did consumer spending on restaurant meals change from a year earlier? computed from publisher values |
5.229 | 5.229 | Correct
2025-08-01 to 2026-08-01 |
| C17 | How fast is e-commerce growing year over year? computed from Census quarterly e-commerce values |
12.187 | 12.187 | Correct
2025-04-01 to 2026-04-01 |
| C18 | How much have parcel and express shipping prices risen in a year? computed from the BLS producer price index |
11.369 | 11.369 | Correct
2025-09-01 to 2026-09-01 |
| C19 | How much did furniture store sales change from a year earlier? computed from Census monthly values |
4.852 | 4.852 | Correct
2025-09-01 to 2026-09-01 |
| C20 | How many jobs did the US economy add last month? BLS CES |
29.0 | 29.0 | Correct
2026-08-01 to 2026-09-01 |
| C21 | How much did the unemployment rate change last month? BLS CPS |
0.1 | 0.1 | Correct
2026-08-01 to 2026-09-01 |
| C22 | What is the 10-year minus 2-year Treasury spread? US Treasury yield curve |
0.3099999999999996 | 0.3099999999999996 | Correct
2026-10-22 |
| C23 | What is the 10-year minus 3-month Treasury spread? US Treasury yield curve |
0.7400000000000002 | 0.7400000000000002 | Correct
2026-10-22 |
| C24 | What were restaurant and bar sales two years ago in today's dollars? Census sales restated with BEA's PCE price index |
86582.93 | 86582.93 | Correct
2024-08-01 in 2026-08 dollars |
| C25 | What were grocery store sales two years ago in today's dollars? Census sales restated with BEA's PCE price index |
78332.9 | 78332.9 | Correct
2024-08-01 in 2026-08 dollars |
| C26 | Are restaurant costs rising faster than menu prices (cost-price gap)? BEA input-output weights x BLS and EIA prices |
0.39 | 0.39 | Correct
2026-08-01 |
| C27 | How much did the diesel price change in the latest week? EIA weekly retail diesel |
0.097 | 0.097 | Correct
2026-10-12 to 2026-10-19 |
| C28 | How much did initial unemployment claims change from the week before? DOL weekly claims |
20301.0 | 20301.0 | Correct
2026-10-03 to 2026-10-10 |
Local markets
Census figures for ZIP codes, cities, counties, metro areas and states (fetched from the Census API), IRS tax-return income, Census's 90% significance test and inflation-adjusted change.
| # | Question | HorizonIQ | Expected | Result |
|---|---|---|---|---|
| L01 | What is the median household income in ZIP 60614 (Chicago)? Census ACS 5-year |
136448.0 ± 7632.0 | 136448.0 ± 7632.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L02 | What is the median household income in ZIP 10021 (Manhattan)? Census ACS 5-year |
158677.0 ± 22110.0 | 158677.0 ± 22110.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L03 | What is the median household income in ZIP 94110 (San Francisco)? Census ACS 5-year |
158351.0 ± 9782.0 | 158351.0 ± 9782.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L04 | What is the median household income in Cook County, IL? Census ACS 5-year |
83498.0 ± 630.0 | 83498.0 ± 630.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L05 | What is the median household income in Travis County, TX? Census ACS 5-year |
99611.0 ± 1578.0 | 99611.0 ± 1578.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L06 | What is the median household income in the Austin metro? Census ACS 5-year |
100431.0 ± 996.0 | 100431.0 ± 996.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L07 | What is the median household income in the city of Austin? Census ACS 5-year |
93658.0 ± 1670.0 | 93658.0 ± 1670.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L08 | What is the median household income in Mississippi? Census ACS 5-year |
56447.0 ± 539.0 | 56447.0 ± 539.0 | Correct
Census ACS 5-year 2020-2024, B19013_001 |
| L09 | How many households are there in ZIP 60614? Census ACS 5-year |
35386.0 ± 960.0 | 35386.0 ± 960.0 | Correct
Census ACS 5-year 2020-2024, B11001_001 |
| L10 | How many households are there in the Chicago metro? Census ACS 5-year |
3643783.0 ± 5293.0 | 3643783.0 ± 5293.0 | Correct
Census ACS 5-year 2020-2024, B11001_001 |
| L11 | How many households are there in Los Angeles County? Census ACS 5-year |
3416449.0 ± 5011.0 | 3416449.0 ± 5011.0 | Correct
Census ACS 5-year 2020-2024, B11001_001 |
| L12 | How many households are there in Texas? Census ACS 5-year |
10992816.0 ± 15813.0 | 10992816.0 ± 15813.0 | Correct
Census ACS 5-year 2020-2024, B11001_001 |
| L13 | How many people live in the city of Austin? Census ACS 5-year |
979539.0 ± 484.0 | 979539.0 ± 484.0 | Correct
Census ACS 5-year 2020-2024, B01003_001 |
| L14 | What share of households in ZIP 10021 earn $200,000 or more? Census ACS 5-year B19001 |
42.1658 ± 3.2086 | 42.1658 ± 3.2086 | Correct
B19001 brackets 17 |
| L15 | What share of households in the San Francisco metro earn $200,000 or more? Census ACS 5-year B19001 |
33.9781 ± 0.3114 | 33.9781 ± 0.3114 | Correct
B19001 brackets 17 |
| L16 | What share of households in Mississippi earn $200,000 or more? Census ACS 5-year B19001 |
5.7501 ± 0.2023 | 5.7501 ± 0.2023 | Correct
B19001 brackets 17 |
| L17 | Is median income in ZIP 10021 higher than in the New York metro area? Census 90% significance test |
higher | higher | Correct
z = 4.43 (158,677 ± 22,110 vs 99,155 ± 487) |
| L18 | Is Travis County's median income different from the Austin metro's? Census 90% significance test |
about the same | about the same | Correct
z = 0.72 (99,611 ± 1,578 vs 100,431 ± 996) |
| L19 | Is Mississippi's median household income below the US median? Census 90% significance test |
lower | lower | Correct
z = 70.84 (56,447 ± 539 vs 80,734 ± 166) |
| L20 | How much has median household income in the Austin metro changed after inflation over five years? Census ACS 2015-2019 vs 2020-2024, BLS CPI-U |
6.52 | 6.52 | Correct
CPI-U factor 1.2270 |
| L21 | How has Mississippi's median household income changed after inflation over five years? Census ACS 2015-2019 vs 2020-2024, BLS CPI-U |
2.05 | 2.05 | Correct
CPI-U factor 1.2270 |
| L22 | What is the average income per tax return in ZIP 60614? IRS Statistics of Income |
300277.2 | 300277.2 | Correct
IRS SOI tax year 2022 |
| L23 | What is the average income per tax return in ZIP 10021? IRS Statistics of Income |
571437.59 | 571437.59 | Correct
IRS SOI tax year 2022 |
| L24 | What is the average income per tax return in ZIP 94301? IRS Statistics of Income |
1641171.71 | 1641171.71 | Correct
IRS SOI tax year 2022 |
| L25 | What does gas cost near ZIP 60614 (Chicago)? EIA weekly, Chicago city area |
4.705 metro:16980 (2026-10-19) | 4.705 metro:16980 (2026-10-19) | Correct
its metro area |
| L26 | What does gas cost in Phoenix? BLS monthly average price, Phoenix metro |
4.691 metro:38060 (2026-09-01) | 4.691 metro:38060 (2026-09-01) | Correct
its metro area |
| L27 | What does gas cost in Missoula, Montana (no city price published)? EIA weekly, Rocky Mountain fuel region |
4.468 padd:4 (2026-10-19) | 4.468 padd:4 (2026-10-19) | Correct
its fuel region |
| L28 | Which US metro area has the highest median household income? Census ACS 5-year, all metro areas |
metro:41940 | metro:41940 | Correct
San Jose-Sunnyvale-Santa Clara, CA Metro Area: $162,111 |
Guardrails
What must not happen: invented numbers, unlicensed data served, misleading statistics, missing source credits.
| # | Question | HorizonIQ | Expected | Result |
|---|---|---|---|---|
| G01 | Give me the series 'bls.cpi.food_awy' (a typo): it must not silently return a different series. | NotFound: Unknown metric 'bls.cpi.food_awy'. Did you mean: bls.cpi.core, bls.cpi.fish_seafood, bls.cpi.food_at_home? Use explore_ontology_nodes or /api/v1/metad | an error mentioning 'Did you mean' | Correct |
| G02 | What is the 30-year mortgage rate from Freddie Mac? (Freddie Mac's terms forbid redistribution.) | Not stored or served by HorizonIQ: Freddie Mac (Primary Mortgage Market Survey)'s terms do not allow storing or commerci | no values; where to get it yourself | Correct |
| G03 | What is the University of Michigan consumer sentiment index? (non-commercial licence) | True | no values (reference only) | Correct |
| G04 | Year-over-year change in ZIP 60614 median income: overlapping 5-year estimates must not be differenced year to year. | 5-year estimates overlap; compare editions five years apart (e.g. 2015-2019 vs 2 | no YoY; a comparison note | Correct |
| G05 | Every number answered carries its source credit (Census notice on local data). | True | Census API notice present | Correct |
| G06 | Every number answered carries its source credit (BLS). | True | credit line present | Correct |
| G07 | Profile of a place that does not exist ('Narnia') must say so, not invent data. | NotFound: No area matches 'Narnia'. Try a ZIP code (60614), a county ('Cook County, Illinois'), a city ('Austin city, Texas'), a metro area ('Chicago metro') or | an error mentioning 'No area matches' | Correct |
| G08 | Inflation-adjusting an interest rate makes no sense and must be refused. | NotFound: nyfed.effr is not a nominal dollar series, so it is not adjusted for inflation | an error mentioning 'not' | Correct |
| G09 | Ranking must leave out estimates too imprecise to rank (CV above 30%). | 50 | no unreliable rows | Correct |
| G10 | Sentences in a local profile never quote an unreliable figure. | 8 | no unreliable figure in the sentences | Correct |
| G11 | Customer account data can never be read through SQL. | ValueError: Disallowed SQL construct: acct_customers | an error | Correct |
| G12 | SQL cannot write or change data. | ValueError: Only SELECT / WITH / DESCRIBE / SUMMARIZE / SHOW / EXPLAIN statements are allowed | an error | Correct |
| G13 | Retired data points explain why they are gone rather than returning old numbers. | NotFound: 'wb.lpi_overall' is no longer offered. World Bank Logistics Performance Index: last published for 2022 (irregular survey); retired as too old. | an error mentioning 'no longer offered' | Correct |
| G14 | Monthly figures that are not seasonally adjusted are labelled as such. | False | seasonally_adjusted = false (CUUR series) | Correct |
| G15 | Yearly local data states which edition it is (no stale numbers passed off as current). | 2020-2024 | edition label like 2020-2024 | Correct |