Amazon, eBay and Airbnb shut AI crawlers out. Most big companies let them in.
We read the robots.txt of every S&P 500 company's website. Only 5% shut out an AI crawler, a quarter of the rate among the most visited websites.
Shuts out at least one AI crawlerLets every AI crawler inShuts out every crawler, Google tooCould not read its file
Shops, travel, cars4 of 47
Real Estate2 of 30
Utilities2 of 31
Technology3 of 75
Financials3 of 76
Industrials3 of 83
Health Care2 of 60
Everyday goods1 of 34
Materials0 of 24
Energy0 of 21
Media, telecom0 of 19
Hover or tap a dot to see the company.
- Only 20 of the 410 companies we could read shut out an AI crawler, 5%, against 20% of the most visited websites.
- Almost none shut out AI search. Only Amazon and Gartner shut out OAI-SearchBot, the crawler behind ChatGPT search.
- Shops, travel and cars shut out the most (11%: Airbnb, Amazon, eBay Inc. and Garmin). Communication services, energy and materials shut out none.
- 18% have an llms.txt, and 31% of technology companies.
- 66 company websites refused our request outright, so what they tell crawlers is not in these numbers.
Figure 1Which industries shut AI crawlers out
| Industry | Any AI crawlerat least one | GPTBotOpenAI, training | OAI-SearchBotChatGPT search | ClaudeBotAnthropic, training | Google-ExtendedGemini | PerplexityBotPerplexity | CCBotCommon Crawl |
|---|---|---|---|---|---|---|---|
| Consumer Discretionary35 companies | 11% | 9% | 3% | 9% | 3% | 9% | 6% |
| Real Estate23 companies | 9% | 9% | 0% | 9% | 9% | 4% | 9% |
| Utilities27 companies | 7% | 7% | 0% | 4% | 4% | 0% | 4% |
| Information Technology58 companies | 5% | 2% | 2% | 2% | 2% | 0% | 3% |
| Financials64 companies | 5% | 3% | 0% | 2% | 3% | 0% | 5% |
| Industrials68 companies | 4% | 3% | 0% | 3% | 4% | 0% | 3% |
| Health Care50 companies | 4% | 4% | 0% | 2% | 2% | 0% | 2% |
| Consumer Staples31 companies | 3% | 3% | 0% | 3% | 3% | 0% | 3% |
| Communication Services16 companies | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| Energy17 companies | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| Materials21 companies | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| All industries410 companies | 5% | 4% | 0% | 3% | 3% | 1% | 3% |
Figure 2Big brands against the most visited websites
S&P 500 companiesTop 1,000 websites
The figures as a table
| Crawler | S&P 500 companies | Top 1,000 websites |
|---|---|---|
| GPTBot | 4% | 13% |
| OAI-SearchBot | 0% | 6% |
| ClaudeBot | 3% | 14% |
| Claude-SearchBot | 0% | 7% |
| Google-Extended | 3% | 11% |
| PerplexityBot | 1% | 10% |
| CCBot | 3% | 16% |
Every company
Search for a company, a ticker or an industry.
| Company | Industry | GPTBot | OAI-SearchBot | ClaudeBot | Claude-SearchBot | Google-Extended | PerplexityBot | CCBot | llms.txt |
|---|---|---|---|---|---|---|---|---|---|
| 3MMMM, www.3m.com | Industrials | Refused our request | |||||||
| A. O. SmithAOS, www.aosmith.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Abbott LaboratoriesABT, abbott.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| AbbVieABBV, www.abbvie.com | Health Care | Open | Open | Open | Open | Open | Open | Open | - |
| AccentureACN, www.accenture.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Adobe Inc.ADBE, www.adobe.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Advanced Micro DevicesAMD, www.amd.com | Information Technology | No usable answer | |||||||
| AES CorporationAES, www.aes.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| AflacAFL, www.aflac.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Agilent TechnologiesA, www.agilent.com | Health Care | Open | Open | Open | Open | Open | Open | Open | - |
| Air ProductsAPD, airproducts.com | Materials | Refused our request | |||||||
| AirbnbABNB, www.airbnb.com | Consumer Discretionary | Shut out | Open | Shut out | Open | Open | Open | Open | No |
| Akamai TechnologiesAKAM, www.akamai.com | Information Technology | Refused our request | |||||||
| Albemarle CorporationALB, www.albemarle.com | Materials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Alexandria Real Estate EquitiesARE, www.are.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Align TechnologyALGN, www.aligntech.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| AllegionALLE, www.allegion.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Alliant EnergyLNT, www.alliantenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| AllstateALL, www.allstate.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Alphabet Inc. (Class A)GOOGL, abc.xyz | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| AltriaMO, www.altria.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| AmazonAMZN, www.amazon.com | Consumer Discretionary | Shut out | Shut out | Shut out | Shut out | Shut out | Shut out | Shut out | No |
| AmcorAMCR, www.amcor.com | Materials | Open | Open | Open | Open | Open | Open | Open | Yes |
| AmerenAEE, www.ameren.com | Utilities | Refused our request | |||||||
| American Electric PowerAEP, www.aep.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| American ExpressAXP, www.americanexpress.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| American International GroupAIG, www.aig.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| American TowerAMT, www.americantower.com | Real Estate | Refused our request | |||||||
| American Water WorksAWK, www.amwater.com | Utilities | Refused our request | |||||||
| Ameriprise FinancialAMP, www.ameriprise.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| AmetekAME, www.ametek.com | Industrials | Refused our request | |||||||
| AmgenAMGN, www.amgen.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| AmphenolAPH, www.amphenol.com | Information Technology | Refused our request | |||||||
| Analog DevicesADI, www.analog.com | Information Technology | No usable answer | |||||||
| Aon plcAON, www.aon.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| APA CorporationAPA, www.apachecorp.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Apollo Global ManagementAPO, www.apollo.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Apple Inc.AAPL, apple.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Applied MaterialsAMAT, www.appliedmaterials.com | Information Technology | Refused our request | |||||||
| AppLovinAPP, www.applovin.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| AptivAPTV, www.aptiv.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Arch Capital GroupACGL, www.archcapgroup.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Archer Daniels MidlandADM, adm.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | Yes |
| Ares ManagementARES, www.aresmgmt.com | Financials | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | No |
| Arista NetworksANET, www.arista.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | - |
| Arthur J. Gallagher & Co.AJG, www.ajg.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| AssurantAIZ, www.assurant.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| AT&TT, www.att.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | Yes |
| Atmos EnergyATO, www.atmosenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| AutodeskADSK, www.autodesk.com | Information Technology | Refused our request | |||||||
| Automatic Data ProcessingADP, www.adp.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| AutoZoneAZO, www.autozone.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | Yes |
| Avery DennisonAVY, averydennison.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Axon EnterpriseAXON, www.axon.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Baker HughesBKR, www.bakerhughes.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Ball CorporationBALL, www.ball.com | Materials | Refused our request | |||||||
| Bank of AmericaBAC, www.bankofamerica.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Baxter InternationalBAX, www.baxter.com | Health Care | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | No |
| Becton DickinsonBDX, www.bd.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| Berkshire HathawayBRK.B, www.berkshirehathaway.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Best BuyBBY, www.bestbuy.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Bio-TechneTECH, www.bio-techne.com | Health Care | No usable answer | |||||||
| BiogenBIIB, www.biogen.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| BlackRockBLK, www.blackrock.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Blackstone Inc.BX, www.blackstone.com | Financials | Refused our request | |||||||
| Block, Inc.XYZ, block.xyz | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Bloom EnergyBE, www.bloomenergy.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| BNY MellonBNY, www.bnymellon.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| BoeingBA, boeing.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Booking HoldingsBKNG, bookingholdings.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | Yes |
| Boston ScientificBSX, www.bostonscientific.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Bristol Myers SquibbBMY, www.bms.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| BroadcomAVGO, www.broadcom.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Broadridge Financial SolutionsBR, www.broadridge.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Brown & BrownBRO, www.bbinsurance.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Brown–FormanBF.B, www.brown-forman.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Bunge GlobalBG, www.bunge.com | Consumer Staples | Refused our request | |||||||
| BXP, Inc.BXP, www.bxp.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| C.H. RobinsonCHRW, www.chrobinson.com | Industrials | Open | Open | Open | Open | Shut out | Open | Open | - |
| Cadence Design SystemsCDNS, www.cadence.com | Information Technology | Refused our request | |||||||
| Camden Property TrustCPT, www.camdenliving.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Capital OneCOF, www.capitalone.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Cardinal HealthCAH, www.cardinalhealth.com | Health Care | No usable answer | |||||||
| Carnival CorporationCCL, www.carnivalcorp.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Carrier GlobalCARR, www.corporate.carrier.com | Industrials | Open | Open | Open | Open | Open | Open | Open | - |
| CarvanaCVNA, www.carvana.com | Consumer Discretionary | Refused our request | |||||||
| Casey'sCASY, www.caseys.com | Consumer Staples | Refused our request | |||||||
| Caterpillar Inc.CAT, www.caterpillar.com | Industrials | No usable answer | |||||||
| Cboe Global MarketsCBOE, www.cboe.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| CBRE GroupCBRE, www.cbre.com | Real Estate | Refused our request | |||||||
| CDW CorporationCDW, www.cdw.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| CencoraCOR, www.cencora.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| Centene CorporationCNC, www.centene.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| CenterPoint EnergyCNP, www.centerpointenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| CF IndustriesCF, www.cfindustries.com | Materials | No usable answer | |||||||
| Charles River LaboratoriesCRL, www.criver.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Charles Schwab CorporationSCHW, www.schwab.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Charter CommunicationsCHTR, www.charter.com | Communication Services | No usable answer | |||||||
| Chevron CorporationCVX, www.chevron.com | Energy | Refused our request | |||||||
| Chipotle Mexican GrillCMG, chipotle.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Chubb LimitedCB, www.chubb.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Church & DwightCHD, www.churchdwight.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| CienaCIEN, www.ciena.com | Information Technology | Refused our request | |||||||
| CignaCI, www.cigna.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| Cincinnati FinancialCINF, www.cinfin.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| CintasCTAS, www.cintas.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| CiscoCSCO, www.cisco.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| CitigroupC, www.citigroup.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Citizens Financial GroupCFG, www.citizensbank.com | Financials | Refused our request | |||||||
| CloroxCLX, www.thecloroxcompany.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| CME GroupCME, www.cmegroup.com | Financials | No usable answer | |||||||
| CMS EnergyCMS, www.cmsenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Coca-Cola Company (The)KO, www.coca-colacompany.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| CognizantCTSH, www.cognizant.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Coherent Corp.COHR, www.coherent.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| CoinbaseCOIN, www.coinbase.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Colgate-PalmoliveCL, www.colgatepalmolive.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| ComcastCMCSA, corporate.comcast.com | Communication Services | No usable answer | |||||||
| Comfort Systems USAFIX, comfortsystemsusa.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| ConocoPhillipsCOP, www.conocophillips.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Consolidated EdisonED, www.coned.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Constellation BrandsSTZ, www.cbrands.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | Yes |
| Constellation EnergyCEG, www.constellation.com | Utilities | Open | Open | Open | Open | Open | Open | Open | Yes |
| Cooper Companies (The)COO, www.coopercos.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| CopartCPRT, www.copart.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Corning Inc.GLW, www.corning.com | Information Technology | Refused our request | |||||||
| CorpayCPAY, www.corpay.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| CoStar GroupCSGP, www.costargroup.com | Real Estate | Refused our request | |||||||
| CostcoCOST, www.costco.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| CRH plcCRH, www.crh.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| CrowdStrikeCRWD, www.crowdstrike.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Crown CastleCCI, www.crowncastle.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| CSX CorporationCSX, www.csx.com | Industrials | Refused our request | |||||||
| CumminsCMI, www.cummins.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| CVS HealthCVS, cvshealth.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| D. R. HortonDHI, www.drhorton.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Danaher CorporationDHR, www.danaher.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Darden RestaurantsDRI, www.darden.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| DatadogDDOG, www.datadoghq.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| DaVitaDVA, www.davita.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Deckers BrandsDECK, www.deckers.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Deere & CompanyDE, www.deere.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Dell TechnologiesDELL, www.delltechnologies.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Delta Air LinesDAL, www.delta.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Devon EnergyDVN, www.devonenergy.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| DexcomDXCM, dexcom.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Diamondback EnergyFANG, www.diamondbackenergy.com | Energy | Refused our request | |||||||
| Digital RealtyDLR, www.digitalrealty.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Dollar GeneralDG, www.dollargeneral.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Dollar TreeDLTR, www.dollartree.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Dominion EnergyD, www.dominionenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Domino'sDPZ, www.dominos.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| DoorDashDASH, www.doordash.com | Consumer Discretionary | Refused our request | |||||||
| Dover CorporationDOV, www.dovercorporation.com | Industrials | Refused our request | |||||||
| Dow Inc.DOW, www.dow.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| DTE EnergyDTE, www.dteenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Duke EnergyDUK, www.duke-energy.com | Utilities | Refused our request | |||||||
| DuPontDD, www.dupont.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Eaton CorporationETN, www.eaton.com | Industrials | No usable answer | |||||||
| eBay Inc.EBAY, www.ebay.com | Consumer Discretionary | Shut out | Open | Shut out | Open | Open | Shut out | Shut out | No |
| EchoStarECHO, www.echostar.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| EcolabECL, www.ecolab.com | Materials | Open | Open | Open | Open | Open | Open | Open | - |
| Edison InternationalEIX, www.edison.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Edwards LifesciencesEW, www.edwardslifesciences.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Elevance HealthELV, www.elevancehealth.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| EmcorEME, www.emcorgroup.com | Industrials | Open | Open | Open | Open | Open | Open | Open | - |
| Emerson ElectricEMR, www.emerson.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| EntergyETR, www.entergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| EOG ResourcesEOG, www.eogresources.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| EQT CorporationEQT, www.eqt.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| EquifaxEFX, www.equifax.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| EquinixEQIX, www.equinix.com | Real Estate | Refused our request | |||||||
| Erie IndemnityERIE, www.erieinsurance.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Essex Property TrustESS, www.essexapartmenthomes.com | Real Estate | No usable answer | |||||||
| Estée Lauder Companies (The)EL, www.elcompanies.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Everest GroupEG, www.everestre.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| EvergyEVRG, www.evergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| EverpureP, www.purestorage.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Eversource EnergyES, www.eversource.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| ExelonEXC, www.exeloncorp.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Expand EnergyEXE, www.chk.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Expedia GroupEXPE, www.expediagroup.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Expeditors InternationalEXPD, www.expeditors.com | Industrials | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | No |
| Extra Space StorageEXR, www.extraspace.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | Yes |
| ExxonMobilXOM, corporate.exxonmobil.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| F5, Inc.FFIV, www.f5.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| FactSetFDS, www.factset.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Fair IsaacFICO, www.fico.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| FastenalFAST, www.fastenal.com | Industrials | Refused our request | |||||||
| Federal Realty Investment TrustFRT, www.federalrealty.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| FedExFDX, www.fedex.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| FedEx FreightFDXF, www.fedex.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Ferguson EnterprisesFERG, www.ferguson.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Fidelity National Information ServicesFIS, www.fisglobal.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Fifth Third BancorpFITB, www.53.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| First SolarFSLR, www.firstsolar.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| FirstEnergyFE, www.firstenergycorp.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| FiservFISV, www.fiserv.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Flex Ltd.FLEX, www.flex.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | - |
| Ford Motor CompanyF, www.ford.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | Yes |
| FortinetFTNT, www.fortinet.com | Information Technology | Open | Open | Shut out | Open | Open | Open | Shut out | - |
| FortiveFTV, www.fortive.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Fox Corporation (Class A)FOXA, foxcorporation.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | - |
| Franklin ResourcesBEN, www.franklintempleton.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Freeport-McMoRanFCX, www.fcx.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| GarminGRMN, www.garmin.com | Consumer Discretionary | Open | Open | Open | Open | Open | Shut out | Open | No |
| GartnerIT, www.gartner.com | Information Technology | Shut out | Shut out | Open | Open | Shut out | Open | Shut out | No |
| GE AerospaceGE, www.geaerospace.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| GE HealthCareGEHC, www.gehealthcare.com | Health Care | Open | Open | Open | Open | Open | Open | Open | - |
| GE VernovaGEV, www.gevernova.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Gen DigitalGEN, www.gendigital.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| GeneracGNRC, www.generac.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| General DynamicsGD, www.gd.com | Industrials | Refused our request | |||||||
| General MillsGIS, www.generalmills.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| General MotorsGM, www.gm.com | Consumer Discretionary | Refused our request | |||||||
| Genuine Parts CompanyGPC, www.genpt.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Gilead SciencesGILD, www.gilead.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Global PaymentsGPN, www.globalpaymentsinc.com | Financials | Refused our request | |||||||
| Globe LifeGL, www.torchmarkcorp.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| GoDaddyGDDY, www.godaddy.com | Information Technology | Refused our request | |||||||
| Goldman SachsGS, www.goldmansachs.com | Financials | Open | Open | Open | Open | Open | Open | Open | - |
| HalliburtonHAL, www.halliburton.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Hartford (The)HIG, www.thehartford.com | Financials | Open | Open | Open | Open | Open | Open | Open | - |
| HasbroHAS, shop.hasbro.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| HCA HealthcareHCA, hcahealthcare.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Healthpeak PropertiesDOC, www.hcpi.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | - |
| Henry ScheinHSIC, www.henryschein.com | Health Care | Refused our request | |||||||
| Hershey Company (The)HSY, www.thehersheycompany.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Hewlett Packard EnterpriseHPE, www.hpe.com | Information Technology | No usable answer | |||||||
| Hilton WorldwideHLT, www.hilton.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Home Depot (The)HD, www.homedepot.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Honeywell AerospaceHONA, www.honeywellaerospace.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Honeywell TechnologiesHON, www.honeywell.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Hormel FoodsHRL, www.hormel.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Host Hotels & ResortsHST, www.hosthotels.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | Yes |
| Howmet AerospaceHWM, www.howmet.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| HP Inc.HPQ, www.hp.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Hubbell IncorporatedHUBB, www.hubbell.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| HumanaHUM, www.humana.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Huntington BancsharesHBAN, www.huntington.com | Financials | Refused our request | |||||||
| Huntington Ingalls IndustriesHII, hii.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| IBMIBM, www.ibm.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| IDEX CorporationIEX, www.idexcorp.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Idexx LaboratoriesIDXX, www.idexx.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Illinois Tool WorksITW, www.itw.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Illumina, Inc.ILMN, www.illumina.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| IncyteINCY, www.incyte.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Ingersoll RandIR, company.ingersollrand.com | Industrials | No usable answer | |||||||
| Insulet CorporationPODD, www.insulet.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| IntelINTC, www.intel.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Interactive BrokersIBKR, www.interactivebrokers.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Intercontinental ExchangeICE, www.intercontinentalexchange.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| International Flavors & FragrancesIFF, www.iff.com | Materials | Open | Open | Open | Open | Open | Open | Open | Yes |
| International PaperIP, www.internationalpaper.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| IntuitINTU, www.intuit.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Intuitive SurgicalISRG, www.intuitive.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| InvescoIVZ, www.invesco.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Invitation HomesINVH, www.invitationhomes.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| IQVIAIQV, www.iqvia.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Iron MountainIRM, www.ironmountain.com | Real Estate | No usable answer | |||||||
| J.B. HuntJBHT, www.jbhunt.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| J.M. Smucker Company (The)SJM, www.jmsmucker.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| JabilJBL, www.jabil.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Jack Henry & AssociatesJKHY, www.jackhenry.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Jacobs SolutionsJ, www.jacobs.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Johnson & JohnsonJNJ, www.jnj.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Johnson ControlsJCI, www.johnsoncontrols.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| JPMorgan ChaseJPM, www.jpmorganchase.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| KenvueKVUE, www.kenvue.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Keurig Dr PepperKDP, www.keurigdrpepper.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| KeyCorpKEY, www.key.com | Financials | Open | Open | Open | Open | Open | Open | Shut out | No |
| Keysight TechnologiesKEYS, www.keysight.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Kimberly-ClarkKMB, www.kimberly-clark.com | Consumer Staples | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | No |
| Kimco RealtyKIM, www.kimcorealty.com | Real Estate | Refused our request | |||||||
| Kinder MorganKMI, www.kindermorgan.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| KKR & Co.KKR, www.kkr.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| KLA CorporationKLAC, www.kla.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Kraft HeinzKHC, www.kraftheinzcompany.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| KrogerKR, www.kroger.com | Consumer Staples | No usable answer | |||||||
| L3HarrisLHX, www.l3harris.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| LabcorpLH, www.labcorp.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| Lam ResearchLRCX, www.lamresearch.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Las Vegas SandsLVS, www.lasvegassands.com | Consumer Discretionary | Refused our request | |||||||
| LeidosLDOS, www.leidos.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| LennarLEN, www.lennar.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | Yes |
| Lennox InternationalLII, www.lennox.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Lilly (Eli)LLY, www.lilly.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Linde plcLIN, www.linde.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Live Nation EntertainmentLYV, www.livenationentertainment.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| Lockheed MartinLMT, lockheedmartin.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Loews CorporationL, www.loews.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Lowe'sLOW, lowes.com | Consumer Discretionary | Refused our request | |||||||
| Lululemon AthleticaLULU, shop.lululemon.com | Consumer Discretionary | No usable answer | |||||||
| LumentumLITE, www.lumentum.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| LyondellBasellLYB, www.lyondellbasell.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| M&T BankMTB, www3.mtb.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Marathon PetroleumMPC, www.marathonpetroleum.com | Energy | Refused our request | |||||||
| Marriott InternationalMAR, www.marriott.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Marsh McLennanMRSH, www.mmc.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Martin Marietta MaterialsMLM, www.martinmarietta.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Marvell TechnologyMRVL, www.marvell.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| MascoMAS, www.masco.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| MastercardMA, www.mastercard.com | Financials | Refused our request | |||||||
| McCormick & CompanyMKC, www.mccormickcorporation.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| McDonald'sMCD, www.mcdonalds.com | Consumer Discretionary | Refused our request | |||||||
| McKessonMCK, www.mckesson.com | Health Care | Refused our request | |||||||
| MedtronicMDT, www.medtronic.com | Health Care | Open | Open | Open | Open | Open | Open | Open | - |
| Merck & Co.MRK, www.merck.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Meta PlatformsMETA, www.meta.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| MetLifeMET, www.metlife.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| Mettler ToledoMTD, www.mt.com | Health Care | Shut out | Open | Open | Open | Open | Open | Open | - |
| MGM ResortsMGM, www.mgmresorts.com | Consumer Discretionary | Refused our request | |||||||
| Microchip TechnologyMCHP, www.microchip.com | Information Technology | Refused our request | |||||||
| Micron TechnologyMU, www.micron.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| MicrosoftMSFT, www.microsoft.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Mid-America Apartment CommunitiesMAA, www.maac.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| ModernaMRNA, www.modernatx.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Mondelez InternationalMDLZ, www.mondelezinternational.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Monolithic Power SystemsMPWR, www.monolithicpower.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Monster BeverageMNST, www.monsterbevcorp.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Moody's CorporationMCO, www.moodys.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Morgan StanleyMS, morganstanley.com | Financials | No usable answer | |||||||
| Mosaic Company (The)MOS, www.mosaicco.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Motorola SolutionsMSI, www.motorolasolutions.com | Information Technology | Refused our request | |||||||
| MSCIMSCI, www.msci.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Nasdaq, Inc.NDAQ, business.nasdaq.com | Financials | No usable answer | |||||||
| NetAppNTAP, www.netapp.com | Information Technology | Refused our request | |||||||
| NetflixNFLX, ir.netflix.net | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| NewmontNEM, www.newmont.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| News Corp (Class A)NWSA, www.newscorp.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| NextEra EnergyNEE, www.nexteraenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Nike, Inc.NKE, www.nike.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| NiSourceNI, www.nisource.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Nordson CorporationNDSN, www.nordson.com | Industrials | Refused our request | |||||||
| Norfolk SouthernNSC, www.norfolksouthern.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Northern TrustNTRS, www.northerntrust.com | Financials | Open | Open | Open | Open | Open | Open | Open | - |
| Northrop GrummanNOC, www.northropgrumman.com | Industrials | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | No |
| Norwegian Cruise Line HoldingsNCLH, www.nclhltd.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| NRG EnergyNRG, www.nrg.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| NucorNUE, www.nucor.com | Materials | Open | Open | Open | Open | Open | Open | Open | - |
| NvidiaNVDA, www.nvidia.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| NVR, Inc.NVR, www.nvrinc.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| NXP SemiconductorsNXPI, www.nxp.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| O'Reilly AutomotiveORLY, www.oreillyauto.com | Consumer Discretionary | Refused our request | |||||||
| Occidental PetroleumOXY, www.oxy.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Old DominionODFL, www.odfl.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Omnicom GroupOMC, www.omnicomgroup.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| ON SemiconductorON, www.onsemi.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| OneokOKE, www.oneok.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Oracle CorporationORCL, www.oracle.com | Information Technology | Refused our request | |||||||
| Otis WorldwideOTIS, www.otis.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| PaccarPCAR, www.paccar.com | Industrials | Refused our request | |||||||
| Packaging Corporation of AmericaPKG, www.packagingcorp.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Palantir TechnologiesPLTR, www.palantir.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Palo Alto NetworksPANW, www.paloaltonetworks.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Parker HannifinPH, www.parker.com | Industrials | Refused our request | |||||||
| PaychexPAYX, www.paychex.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| PayPalPYPL, www.paypal.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| PentairPNR, www.pentair.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| PepsiCoPEP, www.pepsico.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| PfizerPFE, www.pfizer.com | Health Care | Refused our request | |||||||
| PG&E CorporationPCG, www.pge.com | Utilities | Shut out | Open | Open | Open | Open | Open | Open | No |
| Philip Morris InternationalPM, www.pmi.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | - |
| Phillips 66PSX, www.phillips66.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Pinnacle West CapitalPNW, www.pinnaclewest.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| PNC Financial ServicesPNC, www.pnc.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| PPG IndustriesPPG, www.ppg.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| PPL CorporationPPL, www.pplweb.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Principal Financial GroupPFG, www.principal.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Procter & GamblePG, www.pg.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Progressive CorporationPGR, www.progressive.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| PrologisPLD, www.prologis.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Prudential FinancialPRU, prudential.com | Financials | Shut out | Open | Open | Open | Shut out | Open | Shut out | No |
| PTC Inc.PTC, www.ptc.com | Information Technology | Refused our request | |||||||
| Public Service Enterprise GroupPEG, www.pseg.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Public StoragePSA, www.publicstorage.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | Yes |
| PulteGroupPHM, pulte.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Qnity ElectronicsQ, www.qnityelectronics.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| QualcommQCOM, www.qualcomm.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Quanta ServicesPWR, www.quantaservices.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Quest DiagnosticsDGX, www.questdiagnostics.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Ralph Lauren CorporationRL, www.ralphlauren.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | - |
| Raymond James FinancialRJF, www.raymondjames.com | Financials | Refused our request | |||||||
| Realty IncomeO, www.realtyincome.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| RedditRDDT, www.reddit.com | Communication Services | Shut out | Shut out | Shut out | Shut out | Shut out | Shut out | Shut out | - |
| Regency CentersREG, www.regencycenters.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Regeneron PharmaceuticalsREGN, www.regeneron.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Regions Financial CorporationRF, www.regions.com | Financials | Partly | Partly | Partly | Partly | Partly | Partly | Partly | No |
| Republic ServicesRSG, www.republicservices.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| ResMedRMD, www.resmed.com | Health Care | Refused our request | |||||||
| RevvityRVTY, revvity.com | Health Care | Refused our request | |||||||
| Robinhood MarketsHOOD, www.robinhood.com | Financials | Open | Open | Open | Open | Open | Open | Open | - |
| Rockwell AutomationROK, www.rockwellautomation.com | Industrials | Refused our request | |||||||
| Rollins, Inc.ROL, www.rollins.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Roper TechnologiesROP, www.roperind.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | - |
| Ross StoresROST, www.rossstores.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Royal Caribbean GroupRCL, www.royalcaribbeangroup.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | - |
| RTX CorporationRTX, www.rtx.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| S&P GlobalSPGI, www.spglobal.com | Financials | Refused our request | |||||||
| SalesforceCRM, www.salesforce.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| SandiskSNDK, www.sandisk.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| SBA CommunicationsSBAC, www.sbasite.com | Real Estate | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | No |
| SchlumbergerSLB, www.slb.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Seagate TechnologySTX, www.seagate.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| SempraSRE, www.sempra.com | Utilities | Shut out | Open | Shut out | Open | Shut out | Open | Shut out | - |
| ServiceNowNOW, www.servicenow.com | Information Technology | Refused our request | |||||||
| Sherwin-WilliamsSHW, www.sherwin-williams.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Simon Property GroupSPG, www.simon.com | Real Estate | Shut out | Open | Shut out | Open | Shut out | Shut out | Shut out | - |
| SkydanceSKYD, skydance.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| Skyworks SolutionsSWKS, www.skyworksinc.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Smurfit WestrockSW, www.smurfitkappa.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| Snap-onSNA, www.snapon.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| SolventumSOLV, www.solventum.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| Southern CompanySO, www.southerncompany.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Southwest AirlinesLUV, www.southwest.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Stanley Black & DeckerSWK, www.stanleyblackanddecker.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| StarbucksSBUX, www.starbucks.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| State Street CorporationSTT, www.statestreet.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Steel DynamicsSTLD, www.steeldynamics.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| SterisSTE, www.steris.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Stryker CorporationSYK, stryker.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| SupermicroSMCI, www.supermicro.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Synchrony FinancialSYF, www.synchronybank.com | Financials | Refused our request | |||||||
| SynopsysSNPS, www.synopsys.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| SyscoSYY, www.sysco.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| T-Mobile USTMUS, www.t-mobile.com | Communication Services | Refused our request | |||||||
| T. Rowe PriceTROW, www.troweprice.com | Financials | Open | Open | Open | Open | Open | Open | Open | - |
| Take-Two InteractiveTTWO, www.take2games.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| Tapestry, Inc.TPR, www.tapestry.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Targa ResourcesTRGP, www.targaresources.com | Energy | Refused our request | |||||||
| Target CorporationTGT, www.target.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | Yes |
| TE ConnectivityTEL, www.te.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | - |
| Teledyne TechnologiesTDY, www.teledyne.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| TeradyneTER, www.teradyne.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Tesla, Inc.TSLA, www.tesla.com | Consumer Discretionary | Refused our request | |||||||
| Texas InstrumentsTXN, www.ti.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Texas Pacific Land CorporationTPL, www.texaspacific.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| TextronTXT, www.textron.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Thermo Fisher ScientificTMO, www.thermofisher.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| TJX CompaniesTJX, www.tjx.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| TKO Group HoldingsTKO, tkogrp.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| Tractor SupplyTSCO, www.tractorsupply.com | Consumer Discretionary | No usable answer | |||||||
| Trane TechnologiesTT, www.tranetechnologies.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| TransDigm GroupTDG, www.transdigm.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Travelers Companies (The)TRV, www.travelers.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Trimble Inc.TRMB, www.trimble.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| Truist FinancialTFC, www.truist.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| TwilioTWLO, www.twilio.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Tyler TechnologiesTYL, tylertech.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Tyson FoodsTSN, www.tyson.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| U.S. BancorpUSB, www.usbank.com | Financials | Open | Open | Open | Open | Open | Open | Open | Yes |
| UberUBER, www.uber.com | Industrials | Open | Open | Open | Open | Open | Open | Open | - |
| UDR, Inc.UDR, www.udr.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | Yes |
| Ulta BeautyULTA, www.ulta.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Union Pacific CorporationUNP, www.up.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| United Airlines HoldingsUAL, ir.united.com | Industrials | Refused our request | |||||||
| United Parcel ServiceUPS, www.ups.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| United RentalsURI, www.unitedrentals.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| UnitedHealth GroupUNH, www.unitedhealthgroup.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| Universal Health ServicesUHS, www.uhsinc.com | Health Care | Open | Open | Open | Open | Open | Open | Open | - |
| Valero EnergyVLO, www.valero.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Veeva SystemsVEEV, www.veeva.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| VentasVTR, www.ventasreit.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| VeraltoVLTO, www.veralto.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| VerisignVRSN, www.verisign.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Verisk AnalyticsVRSK, www.verisk.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| VerizonVZ, www.verizon.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | Yes |
| Vertex PharmaceuticalsVRTX, www.vrtx.com | Health Care | Refused our request | |||||||
| VertivVRT, www.vertiv.com | Industrials | Open | Open | Open | Open | Open | Open | Open | Yes |
| ViatrisVTRS, www.viatris.com | Health Care | No usable answer | |||||||
| Vici PropertiesVICI, viciproperties.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Visa Inc.V, corporate.visa.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| Vistra Corp.VST, www.vistracorp.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Vivmark ResidentialVMRK, www.equityapartments.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | - |
| Vulcan Materials CompanyVMC, www.vulcanmaterials.com | Materials | Open | Open | Open | Open | Open | Open | Open | No |
| VylorVYLR, www.corteva.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| W. R. Berkley CorporationWRB, www.wrberkley.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| W. W. GraingerGWW, www.grainger.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| WabtecWAB, www.wabteccorp.com | Industrials | Refused our request | |||||||
| WalmartWMT, www.walmart.com | Consumer Staples | Open | Open | Open | Open | Open | Open | Open | No |
| Walt Disney Company (The)DIS, thewaltdisneycompany.com | Communication Services | Open | Open | Open | Open | Open | Open | Open | No |
| Waste ManagementWM, www.wm.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Waters CorporationWAT, www.waters.com | Health Care | No usable answer | |||||||
| WEC Energy GroupWEC, www.wisconsinenergy.com | Utilities | No website at that address | |||||||
| Wells FargoWFC, www.wellsfargo.com | Financials | Open | Open | Open | Open | Open | Open | Open | No |
| WelltowerWELL, welltower.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| West Pharmaceutical ServicesWST, www.westpharma.com | Health Care | Open | Open | Open | Open | Open | Open | Open | Yes |
| Western DigitalWDC, www.westerndigital.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | Yes |
| WeyerhaeuserWY, www.weyerhaeuser.com | Real Estate | Open | Open | Open | Open | Open | Open | Open | No |
| Williams CompaniesWMB, www.williams.com | Energy | Open | Open | Open | Open | Open | Open | Open | No |
| Williams-Sonoma, Inc.WSM, www.williams-sonomainc.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Willis Towers WatsonWTW, www.wtwco.com | Financials | No usable answer | |||||||
| Workday, Inc.WDAY, www.workday.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Wynn ResortsWYNN, www.wynnresorts.com | Consumer Discretionary | Open | Open | Open | Open | Open | Open | Open | No |
| Xcel EnergyXEL, www.xcelenergy.com | Utilities | Open | Open | Open | Open | Open | Open | Open | No |
| Xylem Inc.XYL, www.xylem.com | Industrials | Open | Open | Open | Open | Open | Open | Open | No |
| Yum! BrandsYUM, yum.com | Consumer Discretionary | No usable answer | |||||||
| Zebra TechnologiesZBRA, www.zebra.com | Information Technology | Open | Open | Open | Open | Open | Open | Open | No |
| Zimmer BiometZBH, www.zimmer.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
| ZoetisZTS, www.zoetis.com | Health Care | Open | Open | Open | Open | Open | Open | Open | No |
500 companies.
How we did it
We took the companies in the S&P 500 from Wikipedia's list (the version of 29 Oct 2026), with the industry each belongs to, and each company's official website from Wikidata. On 29 October 2026 we read each website's robots.txt in the same way as in our first crawler study: one request per site, under our own name, following the robots.txt standard. We could read the file for 410 of the 500 companies.
Technical details
Where a company lists several websites, we took the one Wikidata marks as preferred, then the one whose address best matches the company's name, then its home page on .com. For a few companies that is a corporate site, not their best-known brand's (abc.xyz for Alphabet, for example). Three companies have no website on Wikidata, so we added theirs by hand. Companies with two kinds of shares count once. Every other detail, from the four test pages to the cross-check of our reading, is as in the first study.
What these numbers cannot tell you
- A robots.txt file is a request, not a lock, and a company can also block crawlers in other ways.
- A company's other websites, such as its shops or its brands' own sites, can have other rules.
- Files change. This is what the websites said on 29 October 2026.
Download the results for every company (a CSV file)
You may reuse the results, including for commercial use, as long as you credit "Visibian Research" and link to this page. They are published under the Creative Commons Attribution 4.0 licence.