With enough uranium and no expectation of high efficiency it is probably not too hard to build a gun type device and I think very well doable by a terrorist group. The tricky part is doing it with little material and high efficiency. And of course a dirty bomb is trivial but also not nearly as scary as often portrait.