Fusion Reactors are safe, as opposed to fission reactors, which are inherently unstable, and are thus only mostly safe, when built right, and well maintained. Let me explain why...
As a contrast, I will tell you how a Fission reactor basicaly works.
certain isotopes of certain elements are naturally unstable, each atom can at any given moment spontainiously disintegrate into a set of smaller components, releasing energy. A nuclear battery (as found on certain spacecraft) simply capturs this energy (from a tiny radioactive source, usually Plutonium). However it was discovered around the begining of the last century that you can induce an unstable atom to disintigrate (decay) if you bombard it with a specific type of radiation, and that further some unstable atoms emit when they decay just the kind of radiation to make other atoms of the same type decay as well, emitting more of this radiation which induces more atoms to decay, emitting more radiation..... et all, you have a nuclear 'Chain reaction'.
(For uranium isotope 235 the radiation is Neutron radiation)
Now this is where the critical mass bit comes in....
Nuclei of atoms (the core of the atom where neutrons and protons, known collectively as nucleons live) are really small, even compared to the size of atoms, if the nuclei were the size of a football and you held it up in the middle of a airport, the outer electrons would be wizzing round the perimiter fence. This means that a neutral particle like a neutron can wizz through the empty space inside atoms without hitting anything, which is why you can find uranium in the ground at all, and why it didn't just all decay in a huge bang shortly after being created. The critical mass is thus simply the amount needed in one place so that slightly more neutrons colide with other uranium 235 nuclei than leave the reaction (and hit the radiation sheilding).
The reactor then works something like this:
you build a pile of uranium 235 (enriched uranium) inside a containment vessel, and with controll rods (which absorb neutrons) fully lowered into the pile. then some coolant is added, (this is what extracts the heat which is used to turn terbines and make electricity)
Then you pull out the controll rods, this increses the number of neutrons inside the reactor, wich increases the reaction rate, further increasing the neutron number. The reactor heats up, as the reactor reaches the desired temperature the controll rods are partially lowered back in, and a balancing act ensues to keep the reaction rate constant at the desiered level.
Catostrophic falior can occur because the reaction is self sustaining, if you pull your controll rods out to far and cant put them back in (chernoble) then the reaction runs away, and the whole thing catches fire (and caused a GAS/STEAM explosion, which threw radioactive waste all over the place, NOT a nuclear explosion in the way a nuclear bomb works).
However, A fusion reactor is different:
The fuel for a fusion reactor is mostly non radioactive (and in reactors that use tritium, a radioactive isotope of hydrogen it us usually manufactured inside the reactor core as it has a short half life, and thus can't be stored very long).
To make it fuse together requires lots of energy and i mean LOTS. In the sun it takes the entire mass of the sun crushing down on its core to sustain the fusion rate. The temperature required in a tokomak reactor (the most common/sucessfull to date design of reactor) is in the millions of kelvin. to make if fuse giant electromagnets and microwave generators blast the plasma till it raches the desired temp and pressure at wich point it starts fusing, if at any point any of the aperatus fails, you seace to compress/heat the plasma, you loose containment, and the fusion stops... instantly. The worst you can do is dmg the iner coating of your reactor needing shutdown and repairs.
However if you insist on imagining doom where none is possible... the ractor has very little radioactive material in it (radioactive as ordinaery matter can become radioactive after prolonged radiation bombardment) and what radioactive material there is has a short halflife, meaning that any radioactive release would be very much shorter lived, and there is much less cleanup needed after reactor decomission. So even if you were to blow the thing up (you would need your own explosives) there wouldn't be any seriouse contamination, all of which would be cleaned up in pretty short order.
It is in other words safe. and if you persist on worrying about hydrogen, go see how much your local highschool chem or physics lab has sotored in gas canistors lying about the place, I can pretty much garentee that any school worht it's salt will have more lying around than you would have inside the reactor.