Creating an Intranet Like the Internet
This is a great idea, but the author is making a mistake (well, &quot;all eggs in the k8s&#x2F;k3s basket is also a mistake&quot;) in banking on CoreDNS.<p>BIND is THE reference DNS server. It <i>is</i> the RFC, and the k8s external-dns sig to dynamically create record for services is the right way to go here, with delegation of some subdomain to k8s if you really want to. BIND&#x27;s ocnfiguration is a relatively tiny text file and some RNDC keys. You could practically run it on on an Arduino, and adding secondaries is mindblowingly simple.<p>BIND supports every single part of the DNS spec. BIND will work with k8s&#x2F;k3s plus whatever infrastructure is added later, out of the box, with no changes, in plain text files. Drive failure? Just grab stuff from git. It is 100% the right solution.<p>K8s&#x2F;k3s are fine, but the authors are dramatically overestimating how far &quot;we admin some websites&quot; is going to take them during major version changes changes which adjust the arguments to kubelet&#x2F;kube-admin, tryint to get some legacy&#x2F;future software working, etc. Either use Kubevirt or, if I were starting this in 2022, I&#x27;d use a system like Nomad as the base and delegate things which belong in k8s to k8s so your core infrastructure doesn&#x27;t depend on the hip tech.<p>Core infrastructure should be boring, stable, and &quot;just work&quot;. PSQL is great. BIND and isc-dhcpd on whatever embedded boards you feel like will run forever, the config will probably never have breaking compatibility changes, and integrate with everything. Layer other things on top of that.<p>Ceph&#x2F;Rook are great. Until you run out of storage. Shared nothing for DNS&#x2F;dhcpd (let them handle transferring themselves). If you need &quot;real&quot; shared storage, pick whichever one you think you can recover when it catastrophically fails, because it WILL catastrophically fail. Ceph will run out of free inodes or the ratio will get too high and nodes will fail to start until you add capacity or recover manually with ceph-osd&#x2F;ceph-bluestore-tool&#x2F;etc.<p>Like k8s, don&#x27;t select tools which are built to be monitored&#x2F;managed by a team of dedicated people for your more or less hobby project in your free time. Pick something boring and stable.<p>If you want to build it like the internet, run it like the internet.<p>The SSL concerns can easily be mitigated. So can whatever weird TLD issues this is talking about with appending &quot;&#x2F;&quot;. Host a private DNS namespace. This has been done for decades. Your DNS servers (BIND) will be authoritative. Users of your network will need to disable DNS-over-http. Or make BIND do it. As mentioned, use Name Constraints for the CA.