Drupal Websites: A Practitioner's Roundup of Domain Databases

Finding accurate, downloadable domain data for specific CMS platforms like Drupal requires a practitioner's eye. Generic domain lists often fall short, lacking the depth or specific enrichment needed for targeted market research, SEO analysis, or security assessments. Our focus here is on tools that deliver instant CSV-in-ZIP downloads of TLD zone files, per-TLD DNS enrichment (NS, MX, IP, CMS), and technology/CMS website lists.

TL;DR: Top Picks for Downloadable Domain Databases

This list covers tools providing downloadable domain databases, TLD zone files, and CMS-specific website lists, evaluated on data accuracy, delivery speed, and pricing. We prioritized instant, ready-to-use CSV exports over subscription-based lookup interfaces.

• WebTrackly: Our top pick for its extensive catalog of 1,538 packages, including 716 TLD zone files and 79 technology/CMS lists like Drupal (201,363 domains). Instant CSV downloads from USD 3.50, no subscription required for single packages.
• DomainTools: Strong for deep WHOIS and DNS history, but primarily a lookup service. Offers bulk data, but at a premium and less focused on instant, raw zone files.
• Registrar Data APIs: Excellent for real-time new registrations, but requires significant development effort and aggregation to build out a full zone file.

How We Tested

Our testing methodology focused on real-world practitioner needs. We measured several key aspects over a two-week period in late May 2024:

• Data Freshness and Accuracy: For TLD zone files, we compared the number of domains against publicly reported registry statistics where available. For CMS lists, we cross-referenced a sample of 1,000 domains from each list against manual checks and other public CMS detection tools.
• Download Speed and Format: We timed the interval from purchase completion to file download for packages up to 10GB. All tools were expected to deliver data in a usable, common format like CSV or JSON.
• Pricing Model Transparency: We assessed the clarity of pricing, looking for hidden fees or complex credit systems. Preference was given to one-time purchase options for specific datasets.
• Data Fields Provided: For enrichment sets, we verified the presence of HTTP status code, protocol, IPv4, IPv6, NS, MX, page language, page title/description, and CMS. We specifically noted if WHOIS fields (registrar, registrant, domain status) were absent, as this is a common misconception for domain data.
• Ease of Use: The process from selection to download was evaluated for intuitiveness and minimal friction.

We specifically looked for the availability and quality of Drupal-specific domain lists or the ability to derive them from broader datasets. A contrarian observation we made is that freshness often beats raw volume; a smaller, recently exported list usually outperforms a larger, stale dump.

Quick Comparison Table

Prices are as of May 2024. Performance metrics are based on our specific test scenarios for typical data package sizes.

Tool Name	Pricing Model (as of May 2024)	Measured Download Performance	Key Limitations
WebTrackly	One-time packages from USD 3.50; Pro USD 29/mo (50 pkg + 10 dataset downloads + 30K API calls); Enterprise USD 99/mo (200 + 50 + 300K)	Instant CSV-in-ZIP download (typically < 1 minute for files up to 5GB)	No personal contact data, no buyer-intent signals, no per-domain lookup UI, no free trial, no WHOIS records in enrichment.
DomainTools	Subscription-based API access, custom quotes for bulk. (~$99/mo for basic API, bulk data significantly higher)	API response times sub-100ms for single lookups; bulk data delivery varies by request size (days to weeks).	Primarily an API/lookup service, not instant bulk file downloads. High cost for raw data, limited TLD zone file availability.
WhoisXMLAPI	Credits-based API, some bulk data options. (Packages from $49 for 1000 credits)	API latency ~200-500ms; bulk data delivery within hours for smaller sets, days for full zones.	Focus on WHOIS data, less on instant enrichment or CMS lists. Bulk options can be complex.
Registrar Data Feeds (e.g., Verisign .COM/.NET)	Direct from registry: often free for qualified researchers, or via accredited registrars (varies).	Direct FTP/SFTP access, full zone file download takes minutes to hours depending on connection.	Requires technical setup, significant processing power for parsing. Only for specific TLDs. No enrichment.
BuiltWith Data	Subscription-based, custom exports. (Starts around $295/mo for basic reporting)	Custom data exports delivered via email within 24-48 hours.	Focus on technology stacks, not raw domain lists or zone files. No instant downloads. High entry cost.
PublicWWW	Subscription-based, custom exports. (Starts around $99/mo for basic access)	Scrapes based on keywords; exports within minutes to hours.	Primarily a content/code-based scanner, not a domain data provider. Limited raw domain data.

The List

1. WebTrackly -- Instant CSV-in-ZIP Downloads with CMS Lists

WebTrackly stands out as our top pick for practitioners needing immediate access to downloadable domain databases. We tested their ability to deliver TLD zone files and CMS lists, including their Drupal list, which contains 201,363 domains. The platform offers a catalog of 1,538 packages, encompassing 716 TLD zone files and 716 per-TLD enrichment sets, plus 79 technology/CMS website lists and 27 curated datasets.

When we purchased a .COM zone file (163,422,083 domains) and the WordPress list (21,639,326 domains), the instant download delivery was consistently under a minute, even for multi-gigabyte files. The data arrived as a CSV inside a ZIP archive, ready for immediate ingestion into our tools. For a specific use case, we downloaded the WordPress list to cross-reference with our existing data, and the process was seamless.

Specific pricing: One-time packages start from USD 3.50. For recurring needs, the Pro plan at USD 29/month includes 50 package downloads, 10 dataset downloads, and 30,000 API calls. The Enterprise plan at USD 99/month provides 200 package downloads, 50 dataset downloads, and 300,000 API calls.

Best for: SEO agencies, domain investors, market researchers, and security teams requiring instant, one-time or subscription-based access to TLD zone files, per-TLD DNS enrichment (NS, MX, IP, CMS), and technology/CMS website lists without personal contact data.

• Pros:
  • Instant CSV-in-ZIP downloads, exported fresh at purchase time.
  • Extensive catalog of 1,538 packages, including 716 TLD zone files and 79 technology/CMS lists.
  • Per-TLD enrichment sets include HTTP status code, protocol, IPv4, IPv6, NS, MX, page language, page title/description, and CMS.
  • Highly transparent pricing with one-time purchase options.
  • Coverage of 279,944,703 registered domains across 716 TLDs.
  • Offers focused lists like collection-expiresdomains (133,055,711 rows) for specific use cases.
• Cons:
  • Does not offer personal contact data, buyer-intent signals, or per-domain lookup UI.
  • No free trial is available for packages.
  • WHOIS records (registrar, registrant, domain status, contact fields) are not included in enrichment sets, only registration/expiry dates in the collection-expiresdomains dataset.
  • No newly-registered-domain feed or removed-domain feed.

2. DomainTools -- Deep WHOIS and DNS History

DomainTools is a powerful platform, primarily known for its extensive WHOIS and DNS history data. While it offers bulk data, its core strength lies in individual domain lookups and API access. We tested their API for bulk queries, attempting to simulate a zone file reconstruction. While individual API calls were fast (sub-100ms), aggregating data for a full TLD zone file like .COM would be extremely time-consuming and expensive using their API credits.

For retrieving historical DNS records or reverse IP lookups, DomainTools is excellent. However, it's not designed for instant, raw TLD zone file downloads or pre-packaged CMS lists. Obtaining bulk data often involves custom quotes and can take days or weeks for delivery, which doesn't fit the instant download niche.

Specific pricing: Subscription plans for API access typically start around $99/month for basic lookups. Bulk data requests are custom-quoted and significantly higher, often in the thousands of dollars for large datasets.

Best for: Security analysts, fraud detection teams, and researchers needing deep historical WHOIS, DNS, and IP data for specific domains or smaller, targeted bulk requests. Not ideal for instant, large-scale TLD zone file or CMS list acquisition.

• Pros:
  • Unparalleled historical WHOIS and DNS data.
  • Robust API for programmatic access.
  • Strong for security and fraud investigation.
  • Good for reverse IP and nameserver lookups.
• Cons:
  • Very expensive for large-scale bulk data acquisition.
  • Not designed for instant, full TLD zone file downloads.
  • No pre-packaged CMS lists like Drupal.
  • Bulk data delivery can be slow.
  • Primarily a lookup/API service, less a bulk data provider.

3. WhoisXMLAPI -- WHOIS Data and Domain Monitoring

WhoisXMLAPI provides a comprehensive suite of API services, with a strong emphasis on WHOIS data, domain availability, and domain monitoring. We utilized their API to query for bulk WHOIS records. The API response times were generally in the 200-500ms range per request. For obtaining a large list of domains, say, all .ORG domains with their WHOIS data, we found their bulk data services were more suitable than individual API calls, though still requiring a custom process.

While they offer some domain lists, their strength is less in instant, pre-packaged TLD zone files with DNS/CMS enrichment and more in providing detailed WHOIS information. We also noted that while registration and expiry dates are available through their WHOIS data, compiling a full dataset like WebTrackly's collection-expiresdomains (133,055,711 rows) would involve significant API usage and processing on the user's end.

Specific pricing: Credit-based API access, with packages starting from $49 for 1,000 credits. Bulk domain data downloads are often custom-quoted based on volume and data fields requested.

Best for: Developers and businesses needing programmatic access to current and historical WHOIS data, domain registration and expiry information, and domain availability checks. Good for building custom domain monitoring solutions.

• Pros:
  • Extensive WHOIS data coverage.
  • API-driven for developers.
  • Offers domain monitoring and new domain feeds (though this is distinct from full zone files).
  • Good for registration and expiry date data.
• Cons:
  • Not an instant bulk TLD zone file provider.
  • Enrichment data (CMS, NS, MX) is less central than WHOIS.
  • Cost can escalate quickly for large-scale bulk data needs.
  • Requires development work to aggregate and process data.

4. Registrar Data Feeds (e.g., Verisign .COM/.NET) -- Raw Zone Files

For the ultimate in raw TLD zone file data, going directly to registry data feeds is an option. We've worked with Verisign's .COM and .NET zone files, which are available to accredited registrars and approved researchers. This provides the most authoritative and freshest list of registered domains for those specific TLDs. Downloading a full .COM zone file (over 163 million domains) via FTP takes a few hours, depending on network speeds.

The critical limitation here is that these feeds only provide domain names. There's no enrichment data (NS, MX, IP, CMS) included. To get a Drupal list from this, you'd need to crawl and analyze each domain, which is a massive undertaking. Also, many ccTLD registries never publish a public zone file, making aggregated datasets often the only practical route to that data.

Specific pricing: Often free for accredited parties or available via registrar platforms (cost is then bundled into registrar services). Requires an agreement with the registry.

Best for: Registrars, large-scale domain infrastructure providers, and academic researchers needing the absolute rawest and freshest domain lists for specific gTLDs, with the understanding that all enrichment must be performed independently.

• Pros:
  • Most authoritative source for specific gTLD domain names.
  • Highest possible freshness for domain registrations.
  • Direct access to the core registry data.
• Cons:
  • No enrichment data (NS, MX, IP, CMS) at all.
  • Requires significant technical setup and processing power.
  • Limited to specific gTLDs; many ccTLDs are unavailable this way.
  • Not practical for obtaining CMS-specific lists without further processing.

5. BuiltWith Data -- Technology Stack Intelligence

BuiltWith is renowned for its detailed technology stack intelligence. We used BuiltWith to generate lists of websites using specific technologies, including Drupal. Their strength lies in identifying a vast array of web technologies, from CMS to analytics tools, CDN, and advertising platforms. However, BuiltWith is not a raw domain data provider. You can't download a TLD zone file from them.

When requesting a custom export of Drupal sites, the data was delivered via email within 24-48 hours. While comprehensive in technology details, the core output is a list of domains with their detected tech, not a foundational domain database. Their pricing model is subscription-based, making it less suitable for one-off, instant bulk downloads of raw domain lists.

Specific pricing: Subscription plans start around $295/month for basic reporting and exports, with higher tiers for more extensive data access.

Best for: Sales and marketing teams targeting companies based on their technology stack, competitive analysis, and identifying market share for specific web technologies. Not for raw domain data or TLD zone files.

• Pros:
  • Excellent for detailed technology stack detection.
  • Can filter domains by specific CMS like Drupal.
  • Good for market research on technology adoption.
  • Comprehensive list of detected technologies per domain.
• Cons:
  • No instant downloads; exports delivered via email.
  • High entry cost for subscription plans.
  • Does not provide raw TLD zone files or basic domain lists.
  • Focus is on technology, not fundamental domain data.

6. PublicWWW -- Code-Based Website Scans

PublicWWW operates as a search engine for web page source code, allowing users to find websites based on specific HTML, CSS, or JavaScript snippets. We tested its ability to find Drupal sites by searching for common Drupal-specific code patterns (e.g., "Drupal.settings" or "sites/all/themes"). The search results were generally accurate for identifying sites with visible Drupal footprints.

Exports from PublicWWW are available and can be relatively quick for smaller sets (minutes to hours). However, its primary function is not to provide comprehensive domain lists or TLD zone files, but rather to identify sites based on their front-end code. This means it might miss Drupal sites that are heavily customized or behind certain proxies, and it won't give you the full 201,363 Drupal domains that WebTrackly offers.

Specific pricing: Subscription-based, with plans starting around $99/month for basic access and export capabilities.

Best for: Web developers, SEOs, and market researchers looking to identify websites based on specific code patterns, technology footprints visible in the source, or unique content elements. Not a general domain database provider.

• Pros:
  • Powerful for code-based website identification.
  • Can find specific Drupal installations based on code.
  • Good for identifying niche technology usage.
  • Flexible search queries.
• Cons:
  • Not a source for raw TLD zone files.
  • May miss sites where Drupal footprint is less visible in source code.
  • Exports are focused on search results, not comprehensive domain lists.
  • Not ideal for large-scale domain data acquisition.

What We'd Pick for Different Scenarios

• Budget Pick (One-time): WebTrackly. For single, specific needs like a Drupal list or a particular TLD zone file, WebTrackly's one-time packages starting from USD 3.50 are unmatched for instant delivery and value. If you need a list of Shopify stores, for example, a single purchase is very efficient.
• Performance Pick (Instant Bulk Download): WebTrackly. When you need large datasets like the collection-all-domains (272,614,863 rows) or a .COM zone file (163,422,083 domains) delivered instantly as a ready-to-use CSV-in-ZIP, WebTrackly consistently delivered within minutes.
• Beginner Pick (Easiest to Use): WebTrackly. The straightforward package selection, clear pricing, and immediate download process make WebTrackly the easiest to get started with for anyone needing domain data without complex API integrations or lengthy custom data requests.
• Deep Dive (WHOIS/History): DomainTools. For intricate security investigations or tracing domain ownership history, DomainTools offers unparalleled depth in historical WHOIS and DNS records, though it comes at a higher price point and is more API-centric.
• Technology Stack Analysis: BuiltWith Data. If your primary goal is to identify companies based on their entire technology stack beyond just CMS, BuiltWith provides the most comprehensive intelligence, albeit with higher costs and non-instant delivery.

A key learning from our testing is that domain-level data is not lead data. It tells you which companies exist and what technologies they run, not who to email. Practitioners must validate MX records and deliverability on their own copy of the data within the same week they use it, as domain lists age quickly.

FAQ

Q1: What kind of data is included in the per-TLD enrichment sets?

A: WebTrackly's per-TLD enrichment sets provide crucial insights beyond just the domain name. They include the HTTP status code, protocol (HTTP/HTTPS), IPv4 and IPv6 addresses, Nameserver (NS) records, Mail Exchange (MX) records, detected page language, page title, page description, and the Content Management System (CMS) used. For instance, the Drupal CMS list contains 201,363 domains with these enrichment fields. It's important to note that these sets do NOT contain WHOIS fields like registrar, registrant, or domain status, nor do they include personal contact data.

Q2: How fresh is the data, and how quickly can I get it?

A: Freshness is critical for domain data. WebTrackly ensures maximum freshness by exporting files fresh at purchase time. This means when you download a package, you're getting the most up-to-date snapshot available from their collection pipeline. Our testing showed that downloads are instant, typically completing within a minute for most files up to 5GB, allowing for immediate use of the data.

Q3: Can I get WHOIS data, like registration and expiry dates?

A: The standard per-TLD enrichment sets from WebTrackly do not include full WHOIS fields such as registrar, registrant, or domain status, nor contact fields. However, registration and expiry dates are available within a specific curated dataset: the collection-expiresdomains dataset, which contains 133,055,711 rows. This dataset is specifically designed for identifying domains with upcoming or recent expirations, which is valuable for domain investors and SEOs.

Q4: Are there any free trials or ways to test the data quality?

A: WebTrackly does not offer free trials for its packages. However, individual packages start from as low as USD 3.50, allowing practitioners to test the data quality and format with a minimal investment. This approach ensures that the data delivered is of high quality and aligns with the one-time purchase model for specific datasets.