Hbase jobs
...Scala, with solid CS fundamentals including data structure and algorithm design • 4+ years contributing to R&D and production deployments of large backend data processing and analysis systems • 3+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra. • 3+ years of experience standing up and automating the deployment of solutions in AWS using the AWS CLI, with a focus on EMR, EC2, S3, EBS, Redshift, Dynamo, VPCs • Knowledge of SQL and MPP databases (e.g. Vertica, Netezza, Greenplum, Aster Data) • Knowledge of professional software engineering best practices for the full software developme...
I need description of 42 technologies. I need it fast: in 3 days, but I want to get 1/3 of results after every day. EACH description need to contain minimun 400 words. 42 articles x 400 words = 16_800 words in total. Each article need to answer the questions: - What is the technology? - How people uses this technol...or two Programming languages: - C - C++ - C# - Ecma Script - GO - Java - Kotlin - Perl - PHP - Python - R - Ruby - Rust OS - Android - Linux Debian - Linux Fedora - Linux Manjaro - Linux Mint - Linux Red Hat - Linux Ubuntu - Windows - FreeBSD - iOS - MacOS - OpenBSD Databases: - Maria DB - Microsoft SQL Server - MySQL - Oracle DB - PostgreSQL NoSQL - Cassandra - Couchbase - Elastisearch - HBase - MongoDB - Redis - Solr Frameworks: - Hadoop - .NET - Node J...
As a Hadoop Administrator, you have experience of working in Hadoop Engineering, Administration for 4+ years. You have experience of deploying, managing, monitoring production grade Hadoop clusters for large deployments. You are well versed with Hadoop frameworks such as Hbase, Hive, and Apache Spark . Experience of working on DataOps, Automation and AWS would be a bigger plus. If you love to solve problems using your skills, then come join the Team Mactores. We have a casual and fun office environment that actively steers clear of rigid "corporate" culture, focuses on productivity and creativity, and allows you to be part of a world class team while still being yourself. What you will do: Implementation of Hadoop services and ongoing administration of Hadoop ...
I have a set of csv files. I have to upload those in Hadoop and access few scenarios alone through hive,pig,mapreduce and hbase.
Hi Sandeep, I am Prashant Gupta, very interested to make a good career with your esteemed organization. Below are my br...make a good career with your esteemed organization. Below are my brief details for your consideration. Experience: 6+ years of overall IT experience and 3.4 years Hands on experience as a Big Data Hadoop Administrator in MapR and Hortonworks Distribution. Current Company: TCS Pvt. Ltd., Bangalore Current Role : I.T. Analyst Proficient-in: Hadoop, HDFS, Hive, Pig, Mapreduce, Oozie, Sqoop, Hbase, Ranger, Kerberos, MySql, Nifi. Qualification: BE, ECE(2013) with 64.% Current Location : Bangalore Please consider my application for this suitable opportunity in Hadoop Admin. Thanks & Regards, Prashant Gupta Mobile: (+91) 9406842909 Email: @
I am able to setup Apache Atlas in my linux box . But require help in hooking Apache Atlas with other Hadoop components like HBase , Hive . This is required for my POC , and it is required in next 1-2 weeks . Let me know if you need any further info.
Need Oracle, Hive, HBase, Java, Scala, and Spark to give support for 2hrs. It's a part-time opportunity. You need to connect work through a remote connection. Need to give 2 hrs a day from mon-fri.
We need immediate support for bigdata administration. Cloudera administration role FOR: (DEV QA and PROD ) Implementation and support of the Hadoop Environment. Performance tuning , working withbbn Teradata team Databasebbn management and application teams. Configuring the security of the cloudera cl...cron schedulers. ET: SFTP/Unix/big-data Database: HADOOP Is used to store all data as file formats and hive is store in databases. Troubleshooting and make sure all the service up and running all the time. This organization will move all databases into the Snowflake Datalake. Snowflakes Datalake (access management ) HDFS Hive Spark Yarn Sqoop Zookeeper Hue Impala Oozie Sentry Kerberos Hbase Nifi Kafka Key-value store AWS EC2 S3. Connector SFTP Talent Airflow AD/LD...
I need Real time experience those who are willing to take classes for me on HDFS, YARN, HIVE, SQOOP, SCALA, MAPREDUCE, HBASE, PIG, FLUME, IMPALA, SPARK
I am looking for java support. Skills needed for this are -->Java 8, apache camel, Kafka, Hbase, java rest APIs, Jenkins and Jira.
Hi, We are looking for Big Data Developers. Required Skill Sets: Core JAVA, API, HDFS, JSON, Mongo DB, HBase, Cassandra
I need to write Spark application in Scala that reads, write, delete and update data through HBase/HDFS Of course data has to be stored in HDFS I am going to provide the data which is publicly available, cluster nodes are from AWS
I am looking for a long term trainer who can teach Big Data and Hadoop. Following are the basic course outlines: Big Data Hadoop and Spark Developer Hadoop Architecture, HDFS, and YARN MapReduce, Sqoop, and Hive Data Ingestion into Big Data System and ETL Apache Hive NoSQL Databases- HBase Apache Spark Next-Generation Big Data Framework Spark Core Processing RDD Spark Graphx etc.
...Data Governance, Data Lineage. Experience with security and authentication in cloud platforms (Azure preferred). Experience with building stream-processing systems, using solutions such as Spark-Streaming or Flink. Experience with integration of data from multiple data sources Experience with building data lakes and data warehouses is highly desirable. Familiar with Hadoop ecosystem (HDFS, HBase etc.), especially Spark. Good understanding of operating systems and networking. Good knowledge of Big Data querying tools. Knowledge of and experience with Azure. Knowledge of various ETL techniques. Knowledge of messaging systems, such as Kafka or RabbitMQ Role Desirables Experience with Spring/Spring Boot Experience with highly scalable web services API design and ...
1. In the existing Cloudera CDH 6.3 cluster and AWS EMR 6.1 cluster, need to install/integrate presto with phoenix to query data present in HBase. 2. You may take appropriate presto, phoenix to put into current data platform
Just to design the data model for hbase/apache druid as an output storage for api calls and have a dry run on sample data
Just to design the data model for hbase as an output storage for api calls and have a dry run on sample data
Just to design the data model for hbase/apache druid as an output storage for api calls and have a dry run on sample data
Just to design the data model for hbase/ apache druid as an output storage for api calls and have a dry run on sample data stored in hive
I need you to develop some software for me. I would like this software to be developed for Linux using SQL.
We are a ED Tech company. Our hbase crashed. Need an expert to help us to recover.
I am looking for a male who is expert in Hadoop, Java, MapReduce, Sqoop, Hive, Hbase and pig with good experience in Design patterns, ETL and Frameworks. Need good communication skills and available to take phone interview US EST time zone during working hours. I will send the job description well in advance. There might be multiple phone interview rounds, and the funds will only be transferred only if the interview is success and the candidate is selected. No bidding more than $500.
need to write python code or shell script to connect to hbase to check the duplicate file name and file patteren validatin check.
Expertly apply techniques to perform big data query manipulation, evaluate various data storage options and type of aggregated data modeling. Through a critical study, choose an appropriate storage model based on the application requirements for processing large amounts of structured and unstructured data. Independently perform data manipulation and querying (including u...choose an appropriate storage model based on the application requirements for processing large amounts of structured and unstructured data. Independently perform data manipulation and querying (including updates, transactions, and indexes) big data applications dealing with high volume using NoSQL. Organize, store the collected data and manipulate by crafting queries. For example, using Hive, HBase and related d...
We have a Java Library the is a common library used by our loading sub-system and web access sub-system that hangs with a problem that seems to be caused by a memory leak as we have seen on various occasions that the memory is exhausted. The library reads information from Hbase. We have a work around in place that stops and starts the processing on a regular interval and the problem does not recur.
Requirement for a "FEMALE" Trainer for ETL Informatica and Big Data Technologies for US based Clients. Need to train and give technical support to few candidates as per their Requirements and Syllabus and MUST HAVE Exp. and knowledge of HADOOP, HBASE, HIVE, Scala, Spark, Sqoop, Flume, Kafka, Python. Must have Strong Knowledge & Hands on Exp. with SQL, Unix Shell Scripting, Ful SDLC Lifecycle and Lean/Agile Methodologies. Good Exp. in end to end implementation of DW BI projects especially in Data Warehouse & Mart Developments. Have to spent around 3-4 hours daily, also they will be paid as for 4 hrs. If interested Please share your contact details (Contact no. & email id) So that I can connect with you.
...experience in Hadoop ecosystem, i.e. Hadoop, Hbase, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python At least 2 years of experience in Informatica ETL Projects, Informatica solution design and documentation Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and mart developments Strong knowledge and hands-on experience in SQL, Unix shell scripting Knowledge and experience with full SDLC lifecycle Experience with Lean / Agile development methodologies Preferred Qualifications: At least 3 years of experience in software development life cycle At least 3 years of experience in Project life cycle activities on development and maintenance projects 3+ years of experience in Hadoop ecosystem, i.e. Hadoop, Hbase, Hive, Scala, SPARK, Sqoop...
1. Good Skill working on Eclipse IDE 2. Coding Skill in Java and Scala Language along with Unit Test writing 3. Experienced in Spark, 4. Hive 5. Oracle DB and HBase. 6. Familiar with version controlling toll Git and Bitbucket 7. DevOps: Jenkins CI/CD Pipeline etc.
Need expert to work related to hadoop, Hbase using Java.
We are a startup company loo...Storage, Azure Video/Audio Transcoding: Amazon Elastic Transcoder, FFMPEG Media Server Configuration: HTTPS, RTMP & HTTP Meanwhile, there are few other technologies that are required- 1) Real-time Analytics- Azure Stream Analytics, Apache Flink, Spark Streaming. 2) Streaming Media System- Nimble Streamer, Wowza Streaming Engine Helix Universal Server. 3) Powerful programming- GWT 4) Database- HBase, Mongo DB, Cassandra, MailChimp Integration, Postgres 5) Cloud Environment- AWS 6) For Database Management- Datastax 7) Phone, Voice & SMS Verification - Twilio, Nexmo. 8) Push Notifications- Twilio, 9) Universal Operating System- Debian 10) emails - Mandrill 11) Storage servers for every music & music video apps - Google Cloud Stor...
looking for a team to maintain a gambling system from china. need to know mandarin. need to know redis hbase nginx springweb dubbo kafka solr jstorm. Q 1, can you let me know how and whats the system structure with the above components? only the correct answer will be considered. Q 2, what's your past projects related to gambling? only team with experiences will be considered Q 3, what's your estimate costing to maintain this project for a year. Give me your costing for team on a monthly basis. Q 4. Whats your company/personal website and contact email?
1. Kafka with spark streaming (experience on D streams to Structured streams) 2. Spark Scala 3. Airflow 4. Hbase 5. Hive 6. Kubernetes 7. ELK stack 8. Graphana 9. Pronetes , Jenkins
Hello, I am working on some project which needs develop shell script which utilities mapr utilities to copy data between source cluster on mapr v 5.2 Hbase into Maprdb on mapr v 6.1. There maybe requirement to copy data between hadoop hdfs locations as well. Need someone with expertise in hadoop to help develop / enhance existing scripts from past programmer with little or no documentation, add documentation for readability. Occasionally develop new program from scratch to help me speed along with my development project. I am looking to get comfortable with the develop, so firstly I had like to offer a fixed price project which includes develop the required scripts, help with optimizing the script, verification the migration is correctly done and also assist in copying any delta...
A talented person is required who has knowledge in Pig, hive Hadoop, Hbase and spark. If you have knowledge feel free to bid
Hello Everyone Need someone EXPERT IN BIG DATA AND DATAWARE HOUSE needed skills of conceptual modelling of a data warehouse, logical design of a data warehouse and implementation of a data warehouse as a collection of internal tables and external tables in Hive, querying a data cube, implementation of HBase table and querying and manipulating data in HBase table
needed skills of conceptual modelling of a data warehouse, logical design of a data warehouse and implementation of a data warehouse as a collection of internal tables and external tables in Hive, querying a data cube, implementation of HBase table and querying and manipulating data in HBase table
I am looking for a developer with a good knowledge of Java Spring framework. Who can develop a 2 page website using Java Rest, Angular, Spring and HBase. Please only bid if you are a java developer. Because of past experience, I am not looking for developers from India and Pakistan.
Develop an...Load and transform large sets of structured and semi structured. Read data from Kafka and process data using Spark. Adopt innovative architectural approaches to leverage in-house data integration capabilities. Analyze existing processes and prepare functional and requirements documents. Develop multiple spark streaming and core jobs with Kafka as a data pipe-line system. Hive external tables on HBase using Insert Overwrite with S3 as data storage. Troubleshoot developed Spark jobs. Manage and review Yarn Application Logs, Spark Event Logs and Metrics sink CSV files. Improve the performance and optimization of the existing jobs in Spark. Develop solutions by utilizing commercial and open source software including Minifi and Nifi to interface big data and relational ...
We are looking for a full stack engineer who is sepcialized in React and Python, postgres. You should have 2+ years of experience in React and Python. - What you need to do Adding new features to ...scripting language (Python, Java/Scala, Ruby, Perl) Experience with developing web applications from scratch Experience working with data pipelines (e.g. Airflow, Luigi, Pinball) Experience with distributed computing frameworks (Hadoop, Spark) Experience working with varied forms of data infrastructure, including: RDBMS (PostgreSQL, MySQL); NoSQL (MongoDB, DynamoDB, Redis); MapReduce (Hadoop, Hive, HBase, Pig); Logging/messaging systems (Kafka, Scribe, Flume, Kinesis, SQS) If you think you are perfect with this position, please send us coverletter. Please apply if you are located in U...
build a simple django website that uses nosql database(prefarably hbase} be able to update details and link tables. very tight deadline. I want it in a day.
Hi I just started working in a new project. I need some help in my project. My project’s primary skill sets are hive. Spark, hbase, aws components (redshift, s3), Jenkins
Cassandra, MySQL, MongoDB, HBase, Big Data & Cloud Data Storage and Management
I require a project that has the following requirements: “Practical” application for big data processing using state-of-the-art big data technologies. Any big data tools including not only Hadoop MapReduce but also other tools in Hadoop Ecosystem (e.g., HBase, Pig, Spark, Giraph). Only using Python libraries (e.g., NumPy, pandas) for data analytics is not acceptable unless the project is in a distributed computing environment. In addition, using only Sqoop is not acceptable. Using a real cluster environment (i.e., a cluster with two or more connected nodes) is recommended for developing and running the application. The project can be developed and run in pseudo-distributed mode using the Cloudera VM. The expected minimum dataset size is 1 GB in pseudo-distributed mode ev...
We need a single dedicated part time resource on hive,spark, Scala,shell scripting and hbase to give support on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 22000 per month and minimum 4+ years of experienced resource only eligible for the bid.
We need a single dedicated part time resource on hive,spark, Scala,shell scripting and hbase to give support on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 22000 per month and minimum 4+ years of experienced resource only eligible for the bid.
We need spark on top of mapreduce and hive and zookeeper and hbase and sqoop and oozie, HDFS too configurations are:AMD EPYC 7401P 24-Core Simultaneous Multithreading RAM: 128 GB DDR4 ECC Hard drive: 2 x 960 GB NVMe Datacenter Edition Needs to be installed webmin like cpanel, without deleting previous things.
Hello, I'm looking for an expert recruitment services. Requirement: We need 2 Data Scientists with machine learning for an initial 3 months on contract basis ...in using tools such as Scikit-Learn, Spark MLlib, R, Weka, GATE, Cluto, Solr. / Lucene, ML-Pack, Vowpal Wabbit, LibSVM, Mallet etc - Analyze large amounts of information to discover trends and patterns. - Proficiency in using query languages such as SQL, Hive, Pig (actual list depends on what you are currently using in your company). - Experience with NoSQL databases, such as MongoDB, Cassandra, HBase (depending on project needs). - Recommend and implement best practices around application of statistical modelling. - Use techniques from artificial intelligence/machine learning to solve supervised and unsupervised lea...
We are looking for Python experts with experience in big data and data science. Must be familiar with Hbase and Hadoop/Spark. P.S: We are looking for freelancers who can work 8 hours a day , 5 days a week on our project. This project is scheduled for 4 weeks. We are targeting free lancers from India.
