Use the Windows API's for registry editing. But I warn you, they are not very programmer friendly. The way to use API's is different from using VB's functions.
The names of the API's you are looking for are amoung others: RegOpenKey(Ex), RegCreateKey(Ex), RegSetValueEx, RegEnumValue, RegEnumKeyEx, RegDeleteValue, RegDeleteKey, RegCloseKey. Those are the primary ones.
I could write a paper on how to use them all, so I suggest you look up examples of how to use these on the web.
The basic order is:
Open key --> You receive a key handle
Do any modifications you like (using the key handle)
Close key (handle)
Greets...
Richard