August 27, 2026

ReshapeX Team

AI Accuracy Index: We asked four AIs the same 100 industrial parts questions

← Back to blog

You paste a part number into ChatGPT to check if it’s still active before you spec it into a build. It answers fast and it sounds sure. You use the answer anyway, because checking it properly means digging through a distributor portal or waiting on a supplier rep, and you have four more of these before lunch.

That confidence is the problem. A general-purpose AI model doesn’t know when it’s guessing, so a wrong answer and a right one arrive in the same tone.

We wanted to know how often that guess is wrong on the questions our customers actually ask: is this part discontinued, what replaces it, does this drive match that motor, will this configuration actually work together. So we ran the same 100 questions, across 14 industrial brands (ATI, Banner, Beckhoff, Datalogic, Festo, Fortress, item, Misumi, Rittal, Siemens, TE Connectivity, The Imaging Source, Turck, and Yaskawa), through our own knowledge grounding layer and through ChatGPT, Gemini, and Claude. Our engineers graded every answer against the verified correct answer: the right part number, the right item ID, the right lifecycle status, the right spec.

ReshapeX got all 100 right. The three general-purpose models landed between 47% and 54%, and none of them cleared 10% on the questions that asked them to match a natural-language spec to one exact part number.

Why general models miss on industrial questions

This isn’t a knock on how these models are built. They’re trained to be broadly useful, not to hold a live, discontinued-when, replaced-by-what map of every industrial catalog. When a general model doesn’t have the fact, it doesn’t say so. It produces the most plausible-sounding answer instead, which is the core problem with using an ungrounded model for parts and specs: a hallucinated part number reads exactly like a real one until someone orders it.

A fair objection: couldn’t the model just search the web for the answer? It can, and it still misses, because the fact usually isn’t sitting on a page waiting to be found. The current spec for a part is often buried in a distributor’s PDF or a portal that isn’t indexed at all. Catalogs go obsolete faster than the web does: a model can search today and still land on a page a manufacturer stopped maintaining after the last revision. And when a search does turn up something, industrial parts routinely have contradictory listings across resellers, cached pages, and translated spec sheets, with nothing in the search result telling the model which one is current. Search finds pages. It doesn’t verify facts, and a wrong fact read off a real web page is just as costly as a hallucinated one.

The pattern showed up hardest in the categories that require chaining several facts together instead of recalling one. Part search, going from a spec to a part number across 44 questions, put the general models between 52% and 61%: better than a coin flip, worse than you’d want to build a bill of materials on. Validation, confirming a part is correct or still current, was their best category at 59% to 71%, and that’s still a real miss rate on a question that’s supposed to be a quick check. Cross reference, finding an equivalent to another supplier’s part or a legacy part, dropped to 38% to 44%. Configuration is where it fell apart: 0% to 9%. That category isn’t assembling a multi-part bill of materials from scratch. Most of the questions in it hand the model a natural-language description of one product, an interface plate for a specific robot mount, a tower light with an exact stack and wiring, and ask for the single exact part number that matches. Get the match wrong and it doesn’t look wrong: the general models answered with the same confidence as when they were right. The full question list is at the end of this article.

ReshapeX held 100% across every one of those categories, on every brand. The answer isn’t generated from a pattern in training data and it isn’t a web search. It’s a tool harness built around a knowledge graph for each brand: drive configurations, fieldbus module compatibility, firmware revisions, approved substitutes, built from the actual catalogs rather than whatever a crawler happened to find. The harness is what lets the model query that graph for a verified fact instead of guessing from training data or a search result. Evals check every answer before it reaches you or your customers, and continuous sync keeps the graph current as manufacturers update their lines.

What this means for the person doing the asking

The engineers and planners who do this lookup today, by habit, by portal, or by calling a rep, already know a wrong part number is expensive: a delayed line, a return, a redesign. They’re the ones who catch it when a general-purpose model hands back a guess with the same confidence as a fact.

That’s the gap a grounding layer closes. It gives them an answer they don’t have to run down a portal to check five times a day, so their judgment goes where it’s actually needed: a nonstandard application, a tradeoff between two viable substitutes, a customer relationship. The expertise is the hard part to build in this business. This is about putting it to use faster, not about who’s doing the asking.

See the full breakdown

If you want the brand-by-brand and category-by-category numbers behind this, they’re in the graphic below. It’s the same 100 questions, the same 14 brands, and the same four systems, scored the same way. The full list of 100 questions, with no answers attached, is at the end of this article, so you can run them yourself.

Bar chart comparing ReshapeX, ChatGPT, Gemini, and Claude accuracy across part search, configuration, cross reference, diagnostics, and validation query types, and across 14 industrial brands. ReshapeX scores 100% in every category and every brand; the three general-purpose models range from 0% to 100% depending on category and brand, averaging 47% to 54% overall.

The 100 questions

These are the 100 questions behind the numbers above, grouped by query type and then by brand, asked exactly as our evaluators wrote them.

Show all 100 questions

Category

Brand

ID

Question

Part search

Banner

BAN-01

We have a Banner EZ-SCREEN LS safety light curtain with 40 mm resolution, and the test rod that shipped with the system has been lost. What is the exact Banner part number for the correct replacement test piece?

Part search

Banner

BAN-02

For a Sure Cross wireless installation with a remote N-Type antenna I need Banner's bulkhead coaxial surge suppressor, N-Type female to N-Type male, with DC blocking. Which part number is currently released and orderable - and is the part listed in Banner's older Wireless Accessories literature still active?

Part search

Banner

BAN-03

I need to order a Banner WLS28-2 LED strip light: non-cascadable, cool white, 570 mm lighted length, clear (non-diffused) window, non-sealed IP50 housing, with the integrated High/Low/Off push-button switch, and terminated with an integral 4-pin M12 male quick disconnect instead of a cable. What is the exact model number?

Part search

Banner

BAN-04

We mounted a Banner LTF time-of-flight laser distance sensor using the SMBAMSLTFIP bracket kit, and one of the two protective windows in that kit is scratched. What is the Banner part number to order a replacement window on its own?

Part search

Banner

BAN-06

I need a Banner TL50 Core tower light. It must be 24 VDC, have five segments ordered top-to-bottom red, amber, green, blue, white, plus an audible alarm. I want standard brightness, a black housing, an integral 2 m cable rather than an M12 connector, and I want each segment and the audible independently controlled by discrete PLC outputs. Give me the one exact Banner SKU I should order. Do not give me alternatives, a family name, or tell me to use the configurator

Part search

Beckhoff

BEC-01

For a robot dress pack I need a pre-assembled Beckhoff EtherCAT cable that is torsion-capable: PUR jacket, 1 x 4 x AWG22, with an M8 straight male 4-pin A-coded plug on one end and a straight RJ45 plug on the other end, 5 m long. What is the exact order number, and what maximum number of cycles does Beckhoff specify for it?

Part search

Beckhoff

BEC-02

I have an AX5160 servo drive and I need drive-integrated safe motion functions (SS1, SS2, SLS, SLP) controlled over FSoE. Which TwinSAFE drive option card do I have to order for that drive?

Part search

Beckhoff

BEC-04

Within the CX7000 series (Arm Cortex embedded PCs with integrated I/Os), which single model has an on-board CANopen commander (master) interface? Give the order number.

Part search

Datalogic

DATALOGIC-05

We need to measure package height on a conveyor for automatic sorting. Packages can be up to 1.2m tall. Which sensor fits?

Part search

Datalogic

DATALOGIC-14

I need an ultrasonic sensor, full metal with base housing and M18 plug cable exit. It should resist 75 C. Give me the exact part number.

Part search

Festo

FESTO-01

Give me the spare parts list for a festo 161414

Part search

Festo

FESTO-03

I purchased a 13363 Cylinder Signal Generator. What products are commonly purchased together with it?

Part search

Festo

FESTO-04

List the screws available as spare parts for product 8171874

Part search

Festo

FESTO-08

What fittings are compatible with a Festo DHRS-10-A according to the recommended accesorries section?

Part search

Festo

FESTO-09

I need an extra replacement covering for my Festo gripper DHRS-10-A

Part search

Misumi

MISUMI-01

Eje lineal recto de acero inoxidable Diámetro: 8mm Longitud: 200mm Con cromado duro, tolerancia g6

Part search

Misumi

MISUMI-02

Collar para eje con opresor Diámetro interno: 6mm Diámetro externo: 15mm Ancho: 8mm Acero niquelado

Part search

Misumi

MISUMI-04

buje autolubricado, con grafito, interior 6mm exterior 10mm longitud 10mm. Tolerancia F7 interna

Part search

Misumi

MISUMI-06

Buen día me puede cotizar: Soportes para Ejes - En forma de T, cuerpo ancho, con ranura superior. De 30 mm 4 pzas

Part search

Misumi

MISUMI-10

Buen día, Ing. Esperando se encuentre de la mejor manera, nos gustaría solicitar cotización del material mostrado en la parte de abajo. BARRA THOMPSON 5/8 X 12 FT 2 PZ

Part search

Misumi

MISUMI-12

Buen dia, POr favor su apoyo para cotizar el siguiente producto: Clamping Shaft collars Diametro interno: 12mm Diametro externo: 25mm Ancho: 6mm Material: 1045 Carbon Steel

Part search

Rittal

RITTAL-11

I need a KX terminal box in 304 stainless, 200 wide, 200 tall, 80 deep. What's the SKU?

Part search

Siemens

SIEMENS-02

what are the lugs for the 3VA5160-5ED41-0AA0

Part search

Siemens

SIEMENS-06

spare battery part number for 6ES7313-1AD03-0AB0

Part search

Siemens

SIEMENS-08

what's the part number for a ET200SP head module for profinet

Part search

TE Connectivity

TE-06

Find a TE Connectivity Intercontec SKU for M27 SIGNAL connector, 26-position, male, plug, with crimp contacts, Lamella Clamp, Ø 14.0 to 17.0 mm clamping range?

Part search

TE Connectivity

TE-07

I'm looking for a Signal connector M15 locktec, 12 pin, male, plug, 7.5 - 9.0 mm cable clamp range

Part search

TE Connectivity

TE-08

I need a TE Connectivity INTERCONTEC M12 power cable plug, 8-position, with SpeedTec quick lock and cable clamp for 8.7–9.9 mm cable

Part search

The Imaging Source

TIS-01

I need an IP67-rated GigE industrial camera from The Imaging Source with a Sony IMX676 12.5 MP square sensor (3,536 x 3,536), monochrome, with an M12 X-coded Ethernet connector and an M12x0.5 lens mount. What is the exact model designation?

Part search

The Imaging Source

TIS-02

For an embedded build I need a 5 MP colour GigE board-level camera from The Imaging Source using the Sony IMX568 Pregius S global-shutter sensor, and it must have BOTH an M12x0.5 lens holder and Power over Ethernet (no separate 12 V supply). Which exact order code do I specify?

Part search

Turck

TURCK-02

I need a Turck uprox inductive sensor with a 15mm sensing range, embeddable mounting, partially-threaded chrome-plated brass housing with 30mm diameter, PNP normally-open output, 6m PVC cable, and a 4-pin M12 straight connector. What is the part number?

Part search

Turck

TURCK-05

Help me to find a Turck US temperature sensor that use a non-contact measurement, that can can measure from -10 °C to 300°C

Part search

Turck

TURCK-06

I'm looking for an M30 ultrasonic diffuse mode sensor with a 300–3000 mm sensing range, two PNP switching outputs (NO/NC programmable), M12 5-pin connector, temperature compensation, Easy-Teach via onboard buttons, IP67 rating, and a LokFast lanyard security device on the cordset. What part number should I order?

Part search

Turck

TURCK-07

I'm looking for a Turck capacitive proximity sensor in an M30 × 1.5 threaded barrel housing, chrome-plated brass, with a 10 mm rated sensing range (flush mountable), DC 3-wire wiring, 10…65 VDC supply, NPN output, NO contact, M12 × 1 connector, IP67 protection, and fine sensitivity adjustment via potentiometer. Which Turck part number covers this?

Part search

Turck

TURCK-10

I’m looking for a Turck weld water control system with a water flowmeter, mechanical flow restrictor, water temperature sensor, water shutoff, water retract module, 3/4 JIC master end connection, and 90° water connection orientation.

Part search

Turck

TURCK-11

I need a Turck inductive sensor, 1.5 mm range, side-sensing, smooth Ø6.5 mm barrel, 3-wire PNP NO, 10–30 VDC

Part search

Turck

TURCK-12

I need to compare Turck capacitive sensors for detecting translucent PET bottles: M30 housing, 10–30 VDC, analog 4-20mA, adjustable sensing up to 15mm — give part numbers + comparison table

Part search

Turck

TURCK-13

Turno 1: What is the part number of a Turck prox sensor with a 2mm range, barrel format, M12 connector? — Turno 2: Refine: Nonembeddable, full-threading chrome-plated brass, 8mm housing, NPN

Part search

item

ITEM-01

0.0.619.69 - que broca necesito para este numero de parte?

Part search

item

ITEM-02

I want to connect two profiles 8 40x40.

Part search

item

ITEM-06

What is the article number of the Slide LRF 8 D10 120x160?

Part search

item

ITEM-08

tengo un fanuc M-2000iA, cual mounting plate me sirve?

Part search

item

ITEM-09

Dame tres opciones de puntales para sistema MB

Part search

item

ITEM-10

I have to machine the fastener holes for a Standard-Fastening Set 8 into a Line 8 profile whose grooves are closed, so I cannot use a jig that locates in the groove - I need the jig that clamps onto the outside of the profile. Which single item article number is the drilling jig for Standard Fastener 8 covering Profiles 8 and Profiles X 8 up to 80 mm width?

Configuration

ATI

ATI-01

I need a configuration. QC for FANUC CR-7iA/L with an A15 module

Configuration

ATI

ATI-02

Please provide the interface plate for a FANUC M-20iB/25C with a QC-20/21 IP.

Configuration

ATI

ATI-03

ATI QC-40Q and FG2 module config please

Configuration

ATI

ATI-04

What is the adapter used to mount a K5 electrical module with a ATI QC-7 on Flat A?

Configuration

ATI

ATI-05

Give me the adapter used to mount a TD control/signal module with a ATI QC-40Q on Flat B

Configuration

ATI

ATI-06

This one is using a Yaskawa GP50 robot. I need a 1x master side and 2x tools sides with around 16+ pneumatic ports and 26+ electrical ports. Do you have something in this range? ATI US version QC

Configuration

ATI

ATI-07

What is the correct interface plate (IP) for an ATI QC-11 mounted on a FANUC M-3iA/6S robot?

Configuration

ATI

ATI-08

For a QC-21, what is the required adapter for a K5 electrical module on flat B?

Configuration

ATI

ATI-09

What is the correct interface plate (IP) for an ATI QC-7 mounted on a UR5e?

Configuration

ATI

ATI-10

ATI QC configuration and IP needed for Fanuc CRX30ia robot?

Configuration

Banner

BAN-07

I need a Banner TL70 tower light for 24 VDC. From top to bottom I need red, yellow, green, blue and white, followed by an audible module. It must have a black housing, standard brightness, an integral 2 m cable, and every light plus the audible must be independently controlled using discrete PLC outputs. Give me the one exact currently orderable Banner SKU. Do not give me a BOM, alternatives, a family name, or tell me to use the configurator.

Cross reference

Fortress

FORTRESS-01

what is the fortress part number for ITM-00050159

Cross reference

Fortress

FORTRESS-02

what is the fortress part number for ITM-00756754

Cross reference

Fortress

FORTRESS-03

what is the fortress part number for ITM-00216878

Cross reference

Misumi

MISUMI-03

Quiero este buje E-LBH16DUU

Cross reference

Misumi

MISUMI-07

Buenas tardes, favor de cotizar 2 piezas LFHS12, dame un alterno en Misumi

Cross reference

Misumi

MISUMI-08

Te escribo porque estoy buscando la referencia de un buje con el siguiente número de parte: • FNYBU-08 | BUJE | 80 PZ ¿Podrías apoyarme con la información de referencias y los tiempos de entrega para este artículo?

Cross reference

Misumi

MISUMI-11

Buenas tardes, me ayudan a cotizar por favor este material en versión Misumi E-LBKCM40LUU, 3 piezas por favor

Cross reference

Rittal

RITTAL-01

I need to cross-reference a Hoffman Concept wall-mount enclosure (part number CSD24248) to a Rittal product. It's a standard mild steel NEMA 4 box.

Cross reference

Rittal

RITTAL-02

What is the replacement for the obsolete Rittal SK 3302.100 compact cooling unit?

Cross reference

Rittal

RITTAL-04

need rittal for hoffman CSD242410

Cross reference

Rittal

RITTAL-06

cross Hoffman A544208LP

Cross reference

Siemens

SIEMENS-05

what is the replacement for :3VL1125-2KM30-0AA0

Cross reference

Siemens

SIEMENS-07

what's teh upgrade part number for SIMATIC STEP 7 STEP 7 Professional 16 1 SIFLS7PROT1600 10411000916194600000

Cross reference

Siemens

SIEMENS-10

can you cross this part number LC1D25G7

Cross reference

TE Connectivity

TE-02

Find the cross reference for 43045-0212 in TE Connectivity's product catalog.

Cross reference

Turck

TURCK-08

Find a Turck replacement for IGS204

Diagnostics / technical support

Siemens

SIEMENS-01

find faq on using the alm as a license server

Diagnostics / technical support

Yaskawa

YASKAWA-01

How many types of grease are used on an AR1440 robot arm?

Diagnostics / technical support

Yaskawa

YASKAWA-02

Please provide the adjustment parameters for the S-Axis pulse limits on the AR700.

Diagnostics / technical support

Yaskawa

YASKAWA-04

what are possible causes for DX200 alarm code 0104 subcode 1?

Diagnostics / technical support

Yaskawa

YASKAWA-05

what is the remedy for YRC1000 ALARM code 0020 subcode1?

Validation / confirmation

Beckhoff

BEC-03

What is the typical E-bus current consumption of an ELM3704-0000 (4-channel multi-function measurement terminal, 24 bit, 10 ksps), in mA?

Validation / confirmation

Datalogic

DATALOGIC-02

What is the IP rating and drop resistance of the PowerScan 9500 industrial scanner?

Validation / confirmation

Datalogic

DATALOGIC-12

What is the factory warranty on the Gryphon 4600 scanner? Does it differ between corded and cordless?

Validation / confirmation

Datalogic

DATALOGIC-13

Can you give me the full spec for this part PK3/00-1H? Can I install it on a 20 mm hole unshielded?

Validation / confirmation

Datalogic

DATALOGIC-15

Warranty period for C12P/00-3E

Validation / confirmation

Festo

FESTO-02

Show me the engineering software for the **ISO cylinder DSNU-12-70-P-A**.

Validation / confirmation

Festo

FESTO-05

When was the Festo DSMI-25-270-A-B rotary actuator discontinued?

Validation / confirmation

Festo

FESTO-06

I need the operating pressure and thread specification for the iso cylinder 1646799

Validation / confirmation

Festo

FESTO-07

How many valve positions can we configure on an MPA-C valve terminal with IO-Link interface?

Validation / confirmation

Fortress

FORTRESS-05

is B5G0LUNB7WY00NMPB1 a good part number?

Validation / confirmation

Fortress

FORTRESS-06

Is YI2Y6SE411T03415D1D1FW A VALID PART NUMBER?

Validation / confirmation

Misumi

MISUMI-09

Buen dia, disculpa tengo la duda si los unicos ejes con tolerancia que fabrican son los que aparecen en su pagina? Ya que necesito ejes con tolerancia y tratado como los pide la marca INA para sus bujes lisos, al igual que SKF para sus baleros. Y lo que veo es que ninguna de las tolerancias tanto de INA como de SKF las ofrecen ustedes en su pagina. Solo feo g6 y f8... Las que sean pero no las que piden los rodamiemtos de mis proveedores. Asi que opté por enviarles este correo para asegurarme.

Validation / confirmation

Siemens

SIEMENS-03

is 3rw5950-0ch00 compatible with the 3RW52 soft starter

Validation / confirmation

Siemens

SIEMENS-09

what is the difference between 4e7 and 4e6 relay sockets

Validation / confirmation

TE Connectivity

TE-03

Is DT04-2P active or obsolete?

Validation / confirmation

TE Connectivity

TE-04

Is there a version of DT04-2P with more positions?

Validation / confirmation

Turck

TURCK-03

Talk me about Bi1.5-HS865-AP6X, it is still being produced?

Validation / confirmation

Turck

TURCK-04

Describe leter by leter this SKU BI2-M12-AP6X-H1141

Validation / confirmation

Turck

TURCK-09

What is the maximum operating pressure of the TS700 temperature sensor?

Validation / confirmation

Yaskawa

YASKAWA-03

What is the repeatability of an AR3120?

Validation / confirmation

item

ITEM-03

Are item products suitable for food-grade applications?

Validation / confirmation

item

ITEM-04

Se puede construir una mesa de 2m de largo con 4 patas?

Validation / confirmation

item

ITEM-05

Cuanto pesa el perfil 2633?

Validation / confirmation

item

ITEM-07

Necesito descargar el archivo CAD de la pieza 38808, es posible?

Want to see how this performs against your own catalog and your own questions? Schedule a meeting via the agent on our homepage and we’ll show you.

Give us your twenty hardest questions.

We’ll demo on your SKUs, run your evals, and cite every answer.

  • Real Examples
  • Working Demo
  • Your Data
Schedule a meeting