parallel processing - How HBase partitions table across regionservers? -


Please tell me how is the HBase partition table on regional server. For example, suppose that my line keys are integers 0 to 10 m and I have 10 field rows.
Does it mean that the first fielder has all the rows 0 to 10m with the key, second 1m-2m, third 2m-3m, ... tenth 9m-10m?

I want my line key to be a timestamp, but most inquiries will be applied to the latest dates, all questions will be processed only one fielder, is this true?

Or maybe this data will be spread in a different way?
Or maybe I can create an area in some way I have area servers, so (as given in the example) server 1 0 - 0,5 m and 3m - 3,5 m keys, this way mine The data will spread evenly, is it possible?

Update

I have just found that the option is hbase.hregion.max.filesize , do you think Will my problem be solved?

WRT partition, you can read Lars on HBbase architecture or Google's Bigtable paper Hbiz "Clone ".

If your line has only one timestamp, yes the field with the biggest key will always be hit with new requests (since one field is served by only one area server).

Do you want to use the timeframe for small scans? If so, consider hitting your keys (search for Google to see what Mozilla did with Soroko).

Can any prefix timestamp with any ID? For example, if you only request data for specific users, then prefill the TS with that user ID and this will give you better load distribution.

If not, then distribute your keys to UUID or something else that will be randomly used.

About hbase.hregion.maxfilesize

Make maximum fixes on that table (which you can do with the shell), it does not Ensure that each area is exactly x MB (where x is the value you set) is bigger. Suppose that your line keys are all timestamps, which means that each new row key is larger than the previous one, this means that this field will always be inserted into this area with the blank end key (the last one). At some point, one of the files will grow more and more through the maximum (affiliate), and that area will be split around the middle. The lower keys will be in your area, the higher keys in one and the other but since your new line key is always Compared to earlier, this means that you will only write on that new area (and so on).

tl; Dr Although you have more than 1000 areas, the area with the largest row key always writes with this schema, which means that the hosting area server will become an obstacle.


-

Comments

Post a Comment

Popular posts from this blog

Eclipse CDT variable colors in editor -

I hope this is a good question to ask here. This programming is related, so I thought it would be better than the superuser, so I am using the CDT C ++ Eclipse plugin. I know how the editor changes colors for some things But is there a way to do that all the variables are different colors? For example in KDEValue, it sets the local variables and square variables in different colors and bold square squares. Can I copy it to CDT? Eclips provides some level of color customization for text editor syntax You can see it on the following: There are many elements, including the Window> Preferences> C / C ++> Editor> Syntax color code that can be changed, assembly, Comments, Preprocessor and Doxian Under the code, it is possible to change the color of some variable types, such as global variables, local variable announcements, local variable references, and parameter variables. But I do not think the code is capable of changing the color of each variable declared....
Read more

AJAX doesn't send POST query -

$ (दस्तावेज़) .ready (function () {function ajaxselectrss (rssurlvar) {var ajaxRequest; // वेरिएबल जो अजाक्स को संभव बनाता है! कोशिश करें कि {// ओपेरा 8.0+, फ़ायरफ़ॉक्स, सफारी अजाक्स अनुरोध} = नया एक्सएमएलएचटीपीआरइवेस्ट ();} कैच (ई) {// इंटरनेट एक्सप्लोरर ब्राउज़र्स {ajaxRequest = new ActiveXObject ("Msxml2.XMLHTTP");} पकड़ो (ई) {try {ajaxRequest = new ActiveXObject ("Microsoft.XMLHTTP");} कैच (ई) {// कुछ गलत चेतावनी ("आपका ब्राउज़र तोड़ दिया!"); वापसी झूठी;}}} // एक बनाएं फ़ंक्शन जो सर्वर से भेजे गए डेटा प्राप्त करेंगे ajaxRequest.onreadystatechange = function () {if (ajaxRequest.readyState == 4) {var ajaxDisplay = document.getElementById ('news'); ajaxDisplay.innerHTML = ajaxRequest.responseText;}} / / Var rssurlvar = $ (this) .attr ("title"); var queryString = "rurl =" + rssurlvar; var urltofile = "rssget.php"; ajaxRequest.open ("पोस्ट", urltofile, सच); ajaxRequ Est.setRequestHeader ("सामग्री-प्र...
Read more

wpf - Custom Message Box Advice -

Well, I'm using a custom window box that comes with some custom control boxes that accompany the text The producers who are displayed are called. I have a defined event, which has been subscribed through the original class, it gets burnt when clicking on the button. However, I can not see how to use it effectively, I would like to return one yes, whether yes or not, but obviously my code will continue to execute, so this Below is some example code to clarify the problem that the method has subscibed by clicking on the button. Message box window Public partial class custom message box: window {public representative message messagebox object sender, event events e); Public event messagebox handler messagebox document; Public Customs Box () {Initial group (); } Public Customsbox (String Message) {InitializeComponent (); This.txtdescription.Text = Message; } Public Customsbox (String Message, String Title, String First BTNtext) {Initialization (); This.lbltitle.Content =...
Read more