https://bobcopeland.com/blog/tags/python/ Recent content in Python on Insignificant Bits Hugo en-US Thu, 16 Feb 2012 13:44:12 +0000 https://bobcopeland.com/blog/2012/02/parsing-hregioninfo-in-python/ Thu, 16 Feb 2012 13:44:12 +0000 http://bobcopeland.com/blog/?p=1790 <p>I&rsquo;ve been doing a fair amount of HBase work lately at $work, not least of which is <a href="https://github.com/bcopeland/pybase">pybase</a>, a python module that encapsulates Thrift and puts it under an API that looks more or less like the Cassandra wrapper <a href="https://github.com/pycassa/pycassa">pycassa</a> (which we also use).</p> <p>When running an HBase cluster, one must very quickly learn the stack from top to bottom and be ready to fix the metadata when catastrophe strikes. Most of the necessary information about HBase regions is stored in the .META. table; unfortunately some of the values therein are serialized HBase Writables. One usually uses JRuby and directly loads Java classes to deal with the deserialization, but we&rsquo;re a Python shop and doing it all over thrift would be ideal.</p>