Job Description
Praescient Analytics is in search of a Data Engineer to help develop best practices and providing consultative advice across a wide range of big data technologies and data management tools for our client. The Data Engineer will be expected to perform duties such as evaluating the performance of current data integrations, data management tools, and associated processes and procedures within a cloud systems environment. This position is fully remote. US Citizenship and a Public Trust clearance will be REQUIRED.
Primary Responsibilities: - Implement ETL/ELT process and architecture within Azure Synapse and Azure Data Factory, including creating lookup tables where necessary to improve performance or efficiency
- Implement pipelines to transfer sever-based data sources into ADLS, or directly to Synapse where appropriate.
- Implement aggregate views to quickly summarize key information and enable high performance queries by analysts and other users
- Monitor and optimize the performance of data pipelines, queries, and ETL processes to minimize latency and maximize throughput, implementing performance tuning techniques as necessary.
- Manage and maintain ADLS file storage directories to support large multi-stage ETL pipelines
- Establish and enforce data management and integration standards to ensure consistency, data quality, and compliance across all data processes and tools
- Establish quality controls for any manual uploads of flat file extracts into ADLS
- Implement fraud flag tables by entity and individual, linking all identified fraud flags for easy access via SQL query
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide support for data-driven decision-making and advanced analytics
- Document all transformation processes and data architecture, including any derived or aggregate fields created to support the architectural design
- Develop and maintain comprehensive documentation for all ETL/ELT processes, data pipelines, data architecture, and data management practices, ensuring all standards and procedures are accurately reflected and easily accessible
Required Qualifications: - 5+ years of hands-on experience maintaining SQL databases, including expert level skills in SQL and T-SQL.
- 5+ years of hands-on experience working in cloud-based environments with distributed SQL pools.
- Experience with designing and implementing ETL/ELT processes in support of cloud-based data analytics environments.
Desired Qualifications: - Experience with distributed systems utilizing tools such as Apache Hadoop and/or Spark.
- Experience with Azure cloud offerings.
- Experience with big data analytic tools such as Azure Synapse or Databricks.
- Experience working with graph databases such as Neo4j.
- Working experience in Agile Scrum environments.
- Experience with source control tools such as GitHub or Azure DevOps
- Bachelor's degree in Data Science, Business Intelligence, Computer Science or related fields, or the equivalent combination of education, professional training, and work experience
If you are a self-starter who is passionate about data analysis and eager to make a meaningful impact, we invite you to apply for this exciting opportunity with Praescient Analytics!
- Very competitive salary based on qualifications and experience.
- Comprehensive, Company paid healthcare for you (We pay your premiums and deductibles)
- 401(k) with company matching
- Travel & performance incentives
- 26 days of paid time off annually
- $5K annual training allowance
- $500 book allowance
- Tuition reimbursement program
Praescient Analytics is committed to providing equal employment opportunities for all. Employees and applicants without regard to race, color, age, religion, sex, sexual orientation, marital status, gender identity, national origin, legally protected physical or mental disability, genetic information, citizenship status, or status in the uniformed services of the United States, status as a disabled veteran or veteran of the Vietnam era, or on any other basis which is protected under applicable law. This includes a commitment to provide a work environment that is free from all forms of illegal harassment including sexual harassment.
This covers all terms and conditions of employment including (but not limited to):
- Hiring, placement, promotion, transfer, or demotion of all job classifications;
- Recruiting, advertising, or solicitation for employment;
- Treatment during employment;
- Rates of pay or other forms of compensation;
- Benefits;
- Selection for training;
- Company sponsored social and recreational activities; and
- Layoff or termination
Applicants selected will be subject to a government security investigation and must meet eligibility requirements for access to classified information.
US Citizenship Required Praescient Analytics is an Equal Opportunity Employer.
Interested Candidates: Please forward your resume to
recruiting@praescientanalytics.com and please visit our website to apply online at
Job Tags
Remote job, Work experience placement,