Resolved: Dash MasterNodes “Error opening block database. Do you want to rebuild the block database now?”

Resolved: Dash MasterNodes “Error opening block database. Do you want to rebuild the block database now?”

Today for some mysterious reason my DashMN went offline. I went ahead and logged in as root and started performing updates and what not. I accidentally started the Dash Masternode as root and after the reboot when I started it as a regular user I came across the following message:

./dashd
Dash server starting
$ : Error opening block database.

Do you want to rebuild the block database now?

and even though I typed in yes, I just got a bunch of ‘y’s over and over and nothing seemed to happen (at least the debug log had showed no activity). Thankfully this had happened to be before and I had a vague recollection of what to do next. My theory is based on the Dash Masternode service running credentials creating and changing ownership of some block database file to themselves. Obviously if you run as root you can take ownership from anyone with no problem, but when a regular user tries to take ownership or write to the file it can’t. So after much research all I could figure out was that I needed to rebuild the block database. Doing further research I discovered the following command line:

$ ./dashd -reindex
Dash server starting

If you run the server daemon with the -reindex option it will start rebuilding / re-indexing the block database. This will take some time of course, but at the end of the day it will be working again.

Here is some sample output when you perform the re-indexing:

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000011d9b08199ae5d9c22b24f2446fbf0aa9d9ff63fed1bd3c4ebba3f  height=211332  log2_work=60.899206  tx=829213  date=2015-01-29 17:36:57 progress=0.300184  cache=124455

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000f0ee5d5308dbca58d90978d608eca70437c542e19c85eae1784da  height=211333  log2_work=60.899215  tx=829218  date=2015-01-29 17:38:26 progress=0.300186  cache=124460

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=0000000000077677d631312c3ee9b47085fb9ec5d41f2dfaa21e7b53c78fcfcd  height=211334  log2_work=60.899223  tx=829224  date=2015-01-29 17:41:46 progress=0.300188  cache=124461

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000f15848e96f91aae165914765ba3e66260688368fdda5f36b68d81  height=211335  log2_work=60.89923  tx=829229  date=2015-01-29 17:45:22 progress=0.300190  cache=124465

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=0000000000155c00c4e1db241ff16d31788814e875815b97414124bb762d4ede  height=211336  log2_work=60.899238  tx=829232  date=2015-01-29 17:45:56 progress=0.300191  cache=124465

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000009d034b7fc0cf6490b73a7c950fd5034942f598ab4dfd640b41ce5  height=211337  log2_work=60.899247  tx=829258  date=2015-01-29 18:01:38 progress=0.300200  cache=124486

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000d8ff3070b89ebd83f34b43fec4b01b866784c33014a727aa26156  height=211338  log2_work=60.899253  tx=829263  date=2015-01-29 18:03:15 progress=0.300202  cache=124491

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000016d0c37a77c933222f1f3d567973bce0bee93ed19dde5a3d761715  height=211339  log2_work=60.899261  tx=829268  date=2015-01-29 18:07:57 progress=0.300204  cache=124496

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000001a20e364cdfdf01ad141421e550bfe708284f493c732b1a635ef37  height=211340  log2_work=60.899267  tx=829270  date=2015-01-29 18:09:01 progress=0.300204  cache=124498

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=0000000000172174f26c8b818f0f25b94a27cf69892587a18b4820972af40d4a  height=211341  log2_work=60.899274  tx=829274  date=2015-01-29 18:10:21 progress=0.300206  cache=124500

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000005972964eda10bd341dc26c178449607a7d892f35b3424af5093bb  height=211342  log2_work=60.89928  tx=829276  date=2015-01-29 18:10:49 progress=0.300207  cache=124502

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000422d5d45555343f789fed3aedb5bb29ce4a1237a088e6582534e8  height=211343  log2_work=60.899287  tx=829278  date=2015-01-29 18:11:11 progress=0.300207  cache=124504

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000001b4df875455ad190c5cf26f44f281b8ef4927f9ef26569f351f812  height=211344  log2_work=60.899294  tx=829281  date=2015-01-29 18:12:34 progress=0.300208  cache=124507

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000003597db65004075f3bac1c3616659c42612c2e0c24b6ca156198b2  height=211345  log2_work=60.899301  tx=829289  date=2015-01-29 18:16:39 progress=0.300211  cache=124510

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=0000000000034844055b34f527fca7ac83ea887400e2787be9f097aba93851d0  height=211346  log2_work=60.899308  tx=829291  date=2015-01-29 18:18:06 progress=0.300212  cache=124512

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000e5760daf2b613b74bdc9e9f4676ad33504087372bb33ab31fb6e5  height=211347  log2_work=60.899316  tx=829294  date=2015-01-29 18:19:00 progress=0.300213  cache=124513

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000014afed69e4bc5aa039afb8af827d53d2d53a491a79806421841cce  height=211348  log2_work=60.899323  tx=829300  date=2015-01-29 18:24:50 progress=0.300215  cache=124513

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000006ac4a1e55908ba51e1db96fd8f1abe42de09bc32421c1758823b2  height=211349  log2_work=60.899331  tx=829304  date=2015-01-29 18:28:38 progress=0.300217  cache=124517

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000001b1545434126dda02ff09027bdf5405abe69aa3ed956f7edb5ed5b  height=211350  log2_work=60.899338  tx=829312  date=2015-01-29 18:33:09 progress=0.300220  cache=124521

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000b2e949b4a95565938879d1b9bf46e29ee89e280e192537c0fb437  height=211351  log2_work=60.899344  tx=829316  date=2015-01-29 18:36:07 progress=0.300221  cache=124524

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000006dc29ceb2ba68977454c22f3d6b3ec4e532ed3948655ca7839edc  height=211352  log2_work=60.899351  tx=829318  date=2015-01-29 18:36:19 progress=0.300222  cache=124525

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=0000000000099afe2e95eace9af0bf1ce0d3bcd78691e6e56c033b24d1c73a00  height=211353  log2_work=60.899358  tx=829320  date=2015-01-29 18:36:35 progress=0.300223  cache=124527

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=0000000000091b521e09e436ecf0d91995114bfd4c4dc8a6cdeb4cc06f2672ed  height=211354  log2_work=60.899365  tx=829324  date=2015-01-29 18:37:56 progress=0.300224  cache=124531

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=000000000006fb6a303adc5086034ac3a8bb4ca6aabed5d73980e49ac61bfb5e  height=211355  log2_work=60.899372  tx=829327  date=2015-01-29 18:40:24 progress=0.300225  cache=124533

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED

2016-08-03 14:52:36 UpdateTip: new best=00000000000f9cd2c02c14175c5b0c375bb1f345a375f824e22eb6895c082ada  height=211356  log2_work=60.899379  tx=829331  date=2015-01-29 18:44:39 progress=0.300227  cache=124532

2016-08-03 14:52:36 ProcessNewBlock : ACCEPTED