DNS Census 2013 - dataset of registered domains and DNS records
DNS Census

dnscensus2013 (294 files)
2nd-level-domains/ac.txt.xz 3.63kB
2nd-level-domains/ad.txt.xz 2.15kB
2nd-level-domains/ae.txt.xz 36.26kB
2nd-level-domains/aero.txt.xz 6.89kB
2nd-level-domains/af.txt.xz 2.92kB
2nd-level-domains/ag.txt.xz 6.69kB
2nd-level-domains/ai.txt.xz 1.21kB
2nd-level-domains/al.txt.xz 14.08kB
2nd-level-domains/am.txt.xz 30.48kB
2nd-level-domains/an.txt.xz 2.56kB
2nd-level-domains/ao.txt.xz 2.28kB
2nd-level-domains/aq.txt.xz 0.28kB
2nd-level-domains/ar.txt.xz 694.98kB
2nd-level-domains/arpa.txt.xz 0.32kB
2nd-level-domains/as.txt.xz 7.68kB
2nd-level-domains/asia.txt.xz 54.49kB
2nd-level-domains/at.txt.xz 1.31MB
2nd-level-domains/au.txt.xz 2.17MB
2nd-level-domains/aw.txt.xz 2.17kB
2nd-level-domains/ax.txt.xz 2.23kB
2nd-level-domains/az.txt.xz 15.58kB
2nd-level-domains/ba.txt.xz 28.30kB
2nd-level-domains/bb.txt.xz 3.09kB
2nd-level-domains/bd.txt.xz 9.15kB
2nd-level-domains/be.txt.xz 1.14MB
2nd-level-domains/bf.txt.xz 1.05kB
2nd-level-domains/bg.txt.xz 42.71kB
2nd-level-domains/bh.txt.xz 2.02kB
2nd-level-domains/bi.txt.xz 2.48kB
2nd-level-domains/biz.txt.xz 3.94MB
2nd-level-domains/bj.txt.xz 1.38kB
2nd-level-domains/bm.txt.xz 14.78kB
2nd-level-domains/bn.txt.xz 2.71kB
2nd-level-domains/bo.txt.xz 8.92kB
2nd-level-domains/br.txt.xz 2.04MB
2nd-level-domains/bs.txt.xz 0.98kB
2nd-level-domains/bt.txt.xz 2.47kB
2nd-level-domains/bw.txt.xz 4.52kB
2nd-level-domains/by.txt.xz 49.81kB
2nd-level-domains/bz.txt.xz 16.56kB
2nd-level-domains/ca.txt.xz 2.65MB
2nd-level-domains/cat.txt.xz 55.72kB
2nd-level-domains/cc.txt.xz 101.80kB
2nd-level-domains/cd.txt.xz 2.01kB
2nd-level-domains/cf.txt.xz 0.23kB
2nd-level-domains/cg.txt.xz 0.32kB
2nd-level-domains/ch.txt.xz 2.37MB
2nd-level-domains/ci.txt.xz 6.52kB
2nd-level-domains/ck.txt.xz 1.26kB
2nd-level-domains/cl.txt.xz 308.76kB
2nd-level-domains/cm.txt.xz 2.96kB
2nd-level-domains/cn.txt.xz 1.33MB
2nd-level-domains/co.txt.xz 279.06kB
2nd-level-domains/com.txt.xz 195.57MB
2nd-level-domains/coop.txt.xz 10.83kB
2nd-level-domains/cr.txt.xz 19.34kB
2nd-level-domains/cu.txt.xz 1.99kB
2nd-level-domains/cv.txt.xz 2.08kB
2nd-level-domains/cx.txt.xz 3.99kB
2nd-level-domains/cy.txt.xz 13.93kB
2nd-level-domains/cz.txt.xz 1.44MB
2nd-level-domains/de.txt.xz 29.36MB
2nd-level-domains/dj.txt.xz 2.49kB
2nd-level-domains/dk.txt.xz 1.18MB
2nd-level-domains/dm.txt.xz 0.76kB
2nd-level-domains/do.txt.xz 14.13kB
2nd-level-domains/dz.txt.xz 3.94kB
2nd-level-domains/ec.txt.xz 31.06kB
2nd-level-domains/edu.txt.xz 20.06kB
2nd-level-domains/ee.txt.xz 133.78kB
2nd-level-domains/eg.txt.xz 7.13kB
2nd-level-domains/er.txt.xz 0.36kB
2nd-level-domains/es.txt.xz 1.25MB
2nd-level-domains/et.txt.xz 1.58kB
2nd-level-domains/eu.txt.xz 3.08MB
2nd-level-domains/fi.txt.xz 486.54kB
2nd-level-domains/fj.txt.xz 2.77kB
2nd-level-domains/fk.txt.xz 0.37kB
2nd-level-domains/fm.txt.xz 35.94kB
2nd-level-domains/fo.txt.xz 4.80kB
2nd-level-domains/fr.txt.xz 2.17MB
2nd-level-domains/ga.txt.xz 0.65kB
2nd-level-domains/gd.txt.xz 5.87kB
2nd-level-domains/ge.txt.xz 35.63kB
2nd-level-domains/gf.txt.xz 0.24kB
2nd-level-domains/gg.txt.xz 3.08kB
2nd-level-domains/gh.txt.xz 2.86kB
2nd-level-domains/gi.txt.xz 1.96kB
2nd-level-domains/gl.txt.xz 3.42kB
2nd-level-domains/gm.txt.xz 1.25kB
2nd-level-domains/gn.txt.xz 0.54kB
2nd-level-domains/gov.txt.xz 18.00kB
2nd-level-domains/gp.txt.xz 3.54kB
2nd-level-domains/gq.txt.xz 0.30kB
2nd-level-domains/gr.txt.xz 471.09kB
2nd-level-domains/gs.txt.xz 3.02kB
2nd-level-domains/gt.txt.xz 27.54kB
2nd-level-domains/gu.txt.xz 0.34kB
2nd-level-domains/gw.txt.xz 0.08kB
2nd-level-domains/gy.txt.xz 3.00kB
2nd-level-domains/hk.txt.xz 141.76kB
2nd-level-domains/hm.txt.xz 0.62kB
2nd-level-domains/hn.txt.xz 4.00kB
2nd-level-domains/hr.txt.xz 117.84kB
2nd-level-domains/ht.txt.xz 1.22kB
2nd-level-domains/hu.txt.xz 721.69kB
2nd-level-domains/id.txt.xz 86.36kB
2nd-level-domains/ie.txt.xz 343.09kB
2nd-level-domains/il.txt.xz 209.82kB
2nd-level-domains/im.txt.xz 10.14kB
2nd-level-domains/in.txt.xz 855.94kB
2nd-level-domains/info.txt.xz 3.61MB
2nd-level-domains/int.txt.xz 0.63kB
2nd-level-domains/io.txt.xz 10.70kB
2nd-level-domains/iq.txt.xz 0.86kB
2nd-level-domains/ir.txt.xz 122.53kB
2nd-level-domains/is.txt.xz 45.01kB
2nd-level-domains/it.txt.xz 2.01MB
2nd-level-domains/je.txt.xz 2.88kB
2nd-level-domains/jm.txt.xz 15.14kB
2nd-level-domains/jo.txt.xz 8.26kB
2nd-level-domains/jobs.txt.xz 11.60kB
2nd-level-domains/jp.txt.xz 2.08MB
2nd-level-domains/ke.txt.xz 21.80kB
2nd-level-domains/kg.txt.xz 11.33kB
2nd-level-domains/kh.txt.xz 5.74kB
2nd-level-domains/ki.txt.xz 0.42kB
2nd-level-domains/km.txt.xz 0.44kB
2nd-level-domains/kn.txt.xz 0.30kB
2nd-level-domains/kp.txt.xz 0.16kB
2nd-level-domains/kr.txt.xz 464.98kB
2nd-level-domains/kw.txt.xz 3.44kB
2nd-level-domains/ky.txt.xz 5.28kB
2nd-level-domains/kz.txt.xz 58.40kB
2nd-level-domains/la.txt.xz 7.30kB
2nd-level-domains/lb.txt.xz 6.52kB
2nd-level-domains/lc.txt.xz 1.47kB
2nd-level-domains/li.txt.xz 21.80kB
2nd-level-domains/lk.txt.xz 14.94kB
2nd-level-domains/lr.txt.xz 0.60kB
2nd-level-domains/ls.txt.xz 0.73kB
2nd-level-domains/lt.txt.xz 228.85kB
2nd-level-domains/lu.txt.xz 98.44kB
2nd-level-domains/lv.txt.xz 151.89kB
2nd-level-domains/ly.txt.xz 16.28kB
2nd-level-domains/ma.txt.xz 23.19kB
2nd-level-domains/mc.txt.xz 6.73kB
2nd-level-domains/md.txt.xz 22.17kB
2nd-level-domains/me.txt.xz 191.52kB
2nd-level-domains/mg.txt.xz 5.68kB
2nd-level-domains/mh.txt.xz 0.06kB
2nd-level-domains/mil.txt.xz 0.77kB
2nd-level-domains/mk.txt.xz 29.24kB
2nd-level-domains/ml.txt.xz 1.10kB
2nd-level-domains/mm.txt.xz 1.02kB
2nd-level-domains/mn.txt.xz 7.74kB
2nd-level-domains/mo.txt.xz 3.48kB
2nd-level-domains/mobi.txt.xz 194.82kB
2nd-level-domains/mp.txt.xz 4.75kB
2nd-level-domains/mq.txt.xz 0.34kB
2nd-level-domains/mr.txt.xz 0.82kB
2nd-level-domains/ms.txt.xz 5.35kB
2nd-level-domains/mt.txt.xz 8.62kB
2nd-level-domains/mu.txt.xz 5.04kB
2nd-level-domains/museum.txt.xz 1.72kB
2nd-level-domains/mv.txt.xz 2.92kB
2nd-level-domains/mw.txt.xz 3.94kB
2nd-level-domains/mx.txt.xz 395.77kB
2nd-level-domains/my.txt.xz 122.22kB
2nd-level-domains/mz.txt.xz 3.80kB
2nd-level-domains/na.txt.xz 3.68kB
2nd-level-domains/name.txt.xz 102.11kB
2nd-level-domains/nc.txt.xz 4.66kB
2nd-level-domains/ne.txt.xz 0.50kB
2nd-level-domains/net.txt.xz 27.71MB
2nd-level-domains/nf.txt.xz 0.61kB
2nd-level-domains/ng.txt.xz 10.42kB
2nd-level-domains/ni.txt.xz 16.24kB
2nd-level-domains/nl.txt.xz 3.48MB
2nd-level-domains/no.txt.xz 430.60kB
2nd-level-domains/np.txt.xz 52.92kB
2nd-level-domains/nr.txt.xz 0.22kB
2nd-level-domains/nu.txt.xz 235.66kB
2nd-level-domains/nz.txt.xz 551.82kB
2nd-level-domains/om.txt.xz 1.46kB
2nd-level-domains/org.txt.xz 19.36MB
2nd-level-domains/pa.txt.xz 6.96kB
2nd-level-domains/pe.txt.xz 57.20kB
2nd-level-domains/pf.txt.xz 3.23kB
2nd-level-domains/pg.txt.xz 6.14kB
2nd-level-domains/ph.txt.xz 49.62kB
2nd-level-domains/pk.txt.xz 77.48kB
2nd-level-domains/pl.txt.xz 1.70MB
2nd-level-domains/pm.txt.xz 0.64kB
2nd-level-domains/pn.txt.xz 0.40kB
2nd-level-domains/pr.txt.xz 1.42kB
2nd-level-domains/pro.txt.xz 132.36kB
2nd-level-domains/ps.txt.xz 6.40kB
2nd-level-domains/pt.txt.xz 244.06kB
Too many files! Click here to view them all.
Type: Dataset
Tags:

Bibtex:
@article{,
title= {DNS Census 2013 - dataset of registered domains and DNS records},
keywords= {},
journal= {},
author= {DNS Census},
year= {2013},
url= {http://dnscensus2013.neocities.org/},
license= {},
abstract= {==Introduction
Probably the last time any person or entity had a complete list of all hostnames on the Internet was in the mid-1980s, when the Domain Name System (DNS) replaced the old, centralized DoD Internet Host table. Some domain registries like Verisign have zone file access programs, which offer a way to download a complete zone file. But many country-code Top Level Domains (ccTLDs) do not offer such programs. Various companies have, usually through crawling large parts of the web, collected a huge number of DNS records, but none have a complete list of all domains.

And even those incomplete lists are in the hands of few companies like Google, Microsoft (Bing) and DomainTools LLC (whois.sc), presumably most major ISPs, and some research organizations like DNS-OARC, where they are treated as closely guarded company secrets. Other than the zone files provided by Verisign and some other registries, there are few datasets freely available for research or data mining.

The DNS Census 2013 is an attempt to provide a public dataset of registered domains and DNS records. It was inspired by the Internet Census 2012 which showed that releasing data anonymously via BitTorrent is a good thing to do. The dataset contains about 2.5 billion DNS records gathered in the years 2012-2013.

==The data
All data is compressed using xz/LZMA2.

==DNS records
DNS records are written into CSV files. There is one file for each DNS record type (A/AAAA/CNAME/DNAME/MX/NS/SOA/TXT). The records are sorted lexicographically by hostname and by time.

==Registered domains lists
If you only care about currently registered domains (e.g. example.com, nominet.org.uk, ?) but not subdomains (e.g. www.example.com, nom-ns1.nominet.org.uk., ?), the registered domains lists are for you. The lists contain only those hostnames for which a DNS record has been observed on or after January 1st, 2013. Each file contains the hostnames registered under one top-level domain. The lists are sorted lexicographically.},
tos= {},
superseded= {},
terms= {}
}

Hosted by users:


Support
Academic Torrents!

Disable your
ad-blocker!

Report