HBase client Performance issue

[mojari]

hbasetest.txt

Hi Yuan ,
Very good morning. As discussed, I am creating the issue.
I used the client https://github.com/alibaba/node-hbase-client/ , which directly connect to HBase, no rest server. I believe this should give better performance or equivalent performance to HBase Rest server.
But while comparing with HBase rest server the response time for fetching a single row is 4 times compare to rest server.
What do you suggest, any improvement is needed. Is this ready for production deployment?
If I am missing anything and we can deploy this on production then let me know what are the changes needed to deploy this code in production.
Also, I need scanner code for this in Java Script.
Otherwise suggest me any optimize library which can directly used for production code.
Please give me suggestion.

[fengmk2]

But while comparing with HBase rest server the response time for fetching a single row is 4 times compare to rest server.

Can you show me those specific response times compare to HBase rest server? How much is the gap?

[mojari]

I am executing following command:
http://10.0.2.15:3000/hbase/cars/row1

For simulating this, I have created a table in hbase name cars and inserted some data. One key can be row1.
For example:

create 'cars', 'vi'
put 'cars', 'row1', 'vi:make', 'bmw'
put 'cars', 'row1', 'vi:model', '5 series'

and so, on.
hbase(main):001:0> scan 'cars'
ROW COLUMN+CELL
row1 column=vi:make, timestamp=1502988699898, value=bmw1
row1 column=vi:model, timestamp=1502988771217, value=5 series
row2 column=vi:make, timestamp=1502961924851, value=foo
row2 column=vi:model, timestamp=1502961924851, value=18
row3 column=vi:make, timestamp=1502988824518, value=5
row3 column=vi:model, timestamp=1502988787756, value=5
3 row(s) in 0.8130 seconds

...
I will be collecting the exact response time in few minutes.

[mojari]

Script ./hbase_getUsinRestAPI.sh execution finished

real 0m0.139s
user 0m0.079s
sys 0m0.038s
[devlab_user@dl-hadoop1 ~]$ time ./hbase_getUsinNodeJS.sh -r 5
Displaying all rows of table IVRHistory

getRow finished

Script ./hbase_getUsinNodeJS.sh execution finished

real 0m0.335s
user 0m0.042s
sys 0m0.041s
[devlab_user@dl-hadoop1 ~]$ time ./hbase_getUsinNodeJS.sh -r 500
Displaying all rows of table IVRHistory

getRow finished

Script ./hbase_getUsinNodeJS.sh execution finished

real 0m27.338s
user 0m1.645s
sys 0m2.568s
[devlab_user@dl-hadoop1 ~]$ time ./hbase_getUsinRestAPI.sh -r 500
Displaying all rows of table IVRHistory

getRow finished

Script ./hbase_getUsinRestAPI.sh execution finished

real 0m6.225s
user 0m1.520s
sys 0m2.493s

[ritesh@localhost bin]$ time ./hbase_getUsinRestAPI.sh -r 50
Displaying all rows of table ivr

getRow finished

Script ./hbase_getUsinRestAPI.sh execution finished

real 0m1.073s
user 0m0.131s
sys 0m0.163s
[ritesh@localhost bin]$ jps\

^C
[ritesh@localhost bin]$ vi hbase_getUsinNodeJS.sh
[ritesh@localhost bin]$ time ./hbase_getUsinNodeJS.sh -r 50
Displaying all rows of table ivr

getRow finished

Script ./hbase_getUsinNodeJS.sh execution finished

real 0m3.092s
user 0m0.129s
sys 0m0.192s

[mojari]

hbaseNodeJSCurlCommand.txt
hbaseRestCurlCommand_1.txt

I am sharing two curl script.

1. time ./hbase_getUsinNodeJS.sh -r 50 //This will connect to our application on port 3000
   2)time ./hbase_getUsinRestAPI.sh -r 50 //This will connect to hbase rest server on port 8080

[mojari]

Hi Yuan,
can you help me on this.please reply.

Thanks

[mojari]

Hi Yuan,

Hope are you doing well. I thought, I can ping you. Actually, I am new to nodejs. Let me know, if you need my assistance on this. If you want you can assign me some work related to this.

Thanks