Senior ETL/Big Data Software Developer
Senior ETL/Big Data Software Developer (4 Openings)
Analyze, design, develop, and implement cloud-based Big Data processing systems and applications using Hadoop, HDFS, HBase, Hive, Scala, Kafka, IBM DataStage, Informatica, JSON, AWS, Cassandra, Teradata, Tableau, NoSQL, and Unix Shell Scripting. Design, develop, and implement data service architecture that ingests real-time data streams, parses JSONs, and loads them in to multiple data persistence stores to provide real-time and offline analytics. Develop processes to extract, transform and load (ETL) the source data to the targets and Data marts. Write complex code to load data into Data marts using Scala on Spark. Work on Data Analysis, Data Exploration, Data Profiling and Insights Extraction. Develop Hive Scripts, Unix Shell scripts, Spark programming for all ETL loading processes and converting the files into parquet in the Hadoop File System. Build and model NoSQL data models with Cassandra. Worked with NoSQL databases like HBase and create HBase tables to load large sets of semi-structured data coming from various sources. Develop complex SQL queries to slice and dice the data and data profiling. Develop statistical techniques and quantitative methodologies to analyze data and generate useful business insights that are used in decision-making applications. Work on Data visualization and Dashboarding tools like Tableau. Work with application programming interfaces (APIs), JSON, and Online Transactional Processing (OLTP) for Real-time & Batch data processing.
Requirements:
Bachelor’s degree or equivalent in Computer Science, Information Systems, or any Engineering field and 5 years of experience as a Software Engineer, Programmer Analyst, Software Developer, or any job title that involves the development of Data Warehousing and/or Big Data solutions and/or ETL applications. Will accept a Master’s degree and 3 years of experience in lieu of Bachelor’s degree and 5 years of experience. Experience must include the development of Big Data and/or ETL applications.
Work Location:
Canopy One Solutions, 4229 Lafayette Center Drive, Suite 1625, Chantilly, VA 20151. Travel/relocation to various unanticipated project locations throughout the US may be required.
Apply to:
HR, Canopy One Solutions, 4229 Lafayette Ctr Dr #1625, Chantilly, VA 20151 or accounts@cannopyone.com. Canopy One Solutions is an Equal Opportunity Employer (EOE).
