Tamás Gulácsi
5d2a1e8d48
add cmd/dump - a dumper
...
Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose.
2013-01-05 23:06:44 +01:00
Tamás Gulácsi
ce7394f3bf
sort writables to be able to skew write probability to lesser ids (older volumes)
2013-01-04 22:49:40 +01:00
Chris Lu
8fb8ebdf14
master can redirect GET/DELETE/POST requests to volume servers. So
...
clients does not always need to remember the volume server locations.
This is good for low~medium sized web site traffic.
2013-01-04 01:02:52 -08:00
Chris Lu
018f0b73be
properly handle quick volume server restart
2012-12-22 16:26:02 -08:00
Chris Lu
ab5e9727a9
reading/setting/reporting correct volume version
2012-12-17 17:51:39 -08:00
Chris Lu
6c8810e4d2
ensure only compatible volume versions are writable
2012-12-17 16:48:54 -08:00
Chris Lu
7e83a75fba
correctly count volumes, to ensure proper capacity management
2012-12-03 21:27:57 -08:00
Chris Lu
e19edccf3a
ensure properly make volume unwritable. Previously passing volumeInfo
...
reference, causing make wrong volumes unwritable!
2012-12-03 20:28:12 -08:00
Chris Lu
2deee3f47c
added proper log messages
2012-11-26 13:12:21 -08:00
Chris Lu
3ef7a34f49
add command line option to control garbage threshold
2012-11-23 17:31:54 -08:00
Chris Lu
94dbe60233
periodically compact volumes
2012-11-23 17:03:27 -08:00
Chris Lu
ccab4217e4
comment change: 3 times of the pulse
2012-11-11 22:37:12 -08:00
Chris Lu
86c8f248bd
support compacting a volume
2012-11-07 01:51:43 -08:00
Chris Lu
3aefea0fe2
show volume status
2012-10-10 01:10:05 -07:00
Chris Lu
6b1e60582c
adding file count and deletion count
2012-10-09 20:53:31 -07:00
Chris Lu
6ce41e30a4
change to 3-digit replication types
2012-09-30 02:20:33 -07:00
Chris Lu
d63c5231ac
url error
2012-09-26 02:02:15 -07:00
Chris Lu
7ee12f14a8
add option to set server's ip address
2012-09-26 01:55:56 -07:00
Chris Lu
ca8c8a56b7
adjusting tests
2012-09-24 02:25:31 -07:00
Chris Lu
e340fbee82
removing set volume location
...
display version number
add default replication type
2012-09-24 02:01:53 -07:00
Chris Lu
df74f538f7
adjusting http status code for creation
...
switch to new lookup implementation
2012-09-23 15:45:26 -07:00
Chris Lu
73dbb3aed9
load configuration file, with topology configured
2012-09-22 20:46:31 -07:00
Chris Lu
a34570fc5b
read topology configuration
2012-09-22 00:01:13 -07:00
Chris Lu
e986dcf5e0
adjusting testing
2012-09-21 01:31:52 -07:00
Chris Lu
a1bc529db6
lots of fix
...
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
2012-09-20 02:11:08 -07:00
Chris Lu
fc9f1da143
handle volume server up/down events
2012-09-19 16:48:04 -07:00
Chris Lu
e19fd68f18
working now to start/stop volume servers
2012-09-19 01:45:30 -07:00
Chris Lu
f3da0906ed
channel based visitor pattern
2012-09-18 14:05:12 -07:00
Chris Lu
b0e250d437
adjusting refresh topology writable volumes(not finished yet)
...
Need to refreshWritableVolumes for each replication type
2012-09-17 01:48:09 -07:00
Chris Lu
6671f576cb
adjusting log messages
2012-09-16 23:21:18 -07:00
Chris Lu
4846a7232e
adjusting return messages for growing volumes
2012-09-16 23:18:47 -07:00
Chris Lu
15ced2398e
adjusting maxVolumeCount if volume server changes it
2012-09-16 19:18:37 -07:00
Chris Lu
9b99240584
can auto grow 00 and 01 replication volumes
2012-09-16 17:31:15 -07:00
Chris Lu
e7c4ee1c64
register reported topology
2012-09-14 01:17:13 -07:00
Chris Lu
4a7833f1bf
replication related work
2012-09-12 01:07:23 -07:00
Chris Lu
e4c0693b03
replication related work on data nodes
2012-09-10 17:08:52 -07:00
Chris Lu
6daf221937
volume layout for each replication level
2012-09-10 00:18:07 -07:00
Chris Lu
8684b0999d
file renaming
2012-09-08 16:43:43 -07:00
Chris Lu
9f4630736d
rename Server to DataNode
...
formatting
2012-09-08 16:25:44 -07:00
Chris Lu
cdd64a8099
dc and rack aware volume allocation
2012-09-03 01:50:04 -07:00
Chris Lu
b95c9860ed
interface and default implementation for node
2012-09-02 14:33:48 -07:00
Chris Lu
a467d5081c
adjusted tests
2012-09-01 13:17:30 -07:00
Chris Lu
c51884ce23
remove extra code
2012-09-01 10:54:41 -07:00
Chris Lu
1760dd083d
remove reservedVolumeCount to simplify volume allocation logic
2012-09-01 10:51:07 -07:00
Chris Lu
c48bda0232
return the node during assigning free volume
2012-09-01 02:43:43 -07:00
Chris Lu
7a30a48027
assign a free volume randomly
2012-09-01 02:20:59 -07:00
Chris Lu
8d0ea07f5f
loading from json setup in tests
2012-08-31 01:35:11 -07:00
Chris Lu
f5d981ab4d
scaffold for tests
2012-08-29 01:42:24 -07:00
Chris Lu
317e12644a
reserve a volume
...
add VolumeId.Next()
2012-08-29 01:37:40 -07:00
Chris Lu
f7adf1687f
reduce duplicated code by using a tree of Node
2012-08-29 00:58:03 -07:00