Commit Graph
57 Commits
Author SHA1 Message Date
Tamás Gulácsi 5d2a1e8d48 add cmd/dump - a dumper
Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose.
2013-01-05 23:06:44 +01:00
Tamás Gulácsi ce7394f3bf sort writables to be able to skew write probability to lesser ids (older volumes) 2013-01-04 22:49:40 +01:00
Chris Lu 8fb8ebdf14 master can redirect GET/DELETE/POST requests to volume servers. So
clients does not always need to remember the volume server locations.
This is good for low~medium sized web site traffic.
2013-01-04 01:02:52 -08:00
Chris Lu 018f0b73be properly handle quick volume server restart 2012-12-22 16:26:02 -08:00
Chris Lu ab5e9727a9 reading/setting/reporting correct volume version 2012-12-17 17:51:39 -08:00
Chris Lu 6c8810e4d2 ensure only compatible volume versions are writable 2012-12-17 16:48:54 -08:00
Chris Lu 7e83a75fba correctly count volumes, to ensure proper capacity management 2012-12-03 21:27:57 -08:00
Chris Lu e19edccf3a ensure properly make volume unwritable. Previously passing volumeInfo
reference, causing make wrong volumes unwritable!
2012-12-03 20:28:12 -08:00
Chris Lu 2deee3f47c added proper log messages 2012-11-26 13:12:21 -08:00
Chris Lu 3ef7a34f49 add command line option to control garbage threshold 2012-11-23 17:31:54 -08:00
Chris Lu 94dbe60233 periodically compact volumes 2012-11-23 17:03:27 -08:00
Chris Lu ccab4217e4 comment change: 3 times of the pulse 2012-11-11 22:37:12 -08:00
Chris Lu 86c8f248bd support compacting a volume 2012-11-07 01:51:43 -08:00
Chris Lu 3aefea0fe2 show volume status 2012-10-10 01:10:05 -07:00
Chris Lu 6b1e60582c adding file count and deletion count 2012-10-09 20:53:31 -07:00
Chris Lu 6ce41e30a4 change to 3-digit replication types 2012-09-30 02:20:33 -07:00
Chris Lu d63c5231ac url error 2012-09-26 02:02:15 -07:00
Chris Lu 7ee12f14a8 add option to set server's ip address 2012-09-26 01:55:56 -07:00
Chris Lu ca8c8a56b7 adjusting tests 2012-09-24 02:25:31 -07:00
Chris Lu e340fbee82 removing set volume location
display version number
add default replication type
2012-09-24 02:01:53 -07:00
Chris Lu df74f538f7 adjusting http status code for creation
switch to new lookup implementation
2012-09-23 15:45:26 -07:00
Chris Lu 73dbb3aed9 load configuration file, with topology configured 2012-09-22 20:46:31 -07:00
Chris Lu a34570fc5b read topology configuration 2012-09-22 00:01:13 -07:00
Chris Lu e986dcf5e0 adjusting testing 2012-09-21 01:31:52 -07:00
Chris Lu a1bc529db6 lots of fix
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
2012-09-20 02:11:08 -07:00
Chris Lu fc9f1da143 handle volume server up/down events 2012-09-19 16:48:04 -07:00
Chris Lu e19fd68f18 working now to start/stop volume servers 2012-09-19 01:45:30 -07:00
Chris Lu f3da0906ed channel based visitor pattern 2012-09-18 14:05:12 -07:00
Chris Lu b0e250d437 adjusting refresh topology writable volumes(not finished yet)
Need to refreshWritableVolumes for each replication type
2012-09-17 01:48:09 -07:00
Chris Lu 6671f576cb adjusting log messages 2012-09-16 23:21:18 -07:00
Chris Lu 4846a7232e adjusting return messages for growing volumes 2012-09-16 23:18:47 -07:00
Chris Lu 15ced2398e adjusting maxVolumeCount if volume server changes it 2012-09-16 19:18:37 -07:00
Chris Lu 9b99240584 can auto grow 00 and 01 replication volumes 2012-09-16 17:31:15 -07:00
Chris Lu e7c4ee1c64 register reported topology 2012-09-14 01:17:13 -07:00
Chris Lu 4a7833f1bf replication related work 2012-09-12 01:07:23 -07:00
Chris Lu e4c0693b03 replication related work on data nodes 2012-09-10 17:08:52 -07:00
Chris Lu 6daf221937 volume layout for each replication level 2012-09-10 00:18:07 -07:00
Chris Lu 8684b0999d file renaming 2012-09-08 16:43:43 -07:00
Chris Lu 9f4630736d rename Server to DataNode
formatting
2012-09-08 16:25:44 -07:00
Chris Lu cdd64a8099 dc and rack aware volume allocation 2012-09-03 01:50:04 -07:00
Chris Lu b95c9860ed interface and default implementation for node 2012-09-02 14:33:48 -07:00
Chris Lu a467d5081c adjusted tests 2012-09-01 13:17:30 -07:00
Chris Lu c51884ce23 remove extra code 2012-09-01 10:54:41 -07:00
Chris Lu 1760dd083d remove reservedVolumeCount to simplify volume allocation logic 2012-09-01 10:51:07 -07:00
Chris Lu c48bda0232 return the node during assigning free volume 2012-09-01 02:43:43 -07:00
Chris Lu 7a30a48027 assign a free volume randomly 2012-09-01 02:20:59 -07:00
Chris Lu 8d0ea07f5f loading from json setup in tests 2012-08-31 01:35:11 -07:00
Chris Lu f5d981ab4d scaffold for tests 2012-08-29 01:42:24 -07:00
Chris Lu 317e12644a reserve a volume
add VolumeId.Next()
2012-08-29 01:37:40 -07:00
Chris Lu f7adf1687f reduce duplicated code by using a tree of Node 2012-08-29 00:58:03 -07:00