Lead Data Engineer

Company: Gartner
Location: Austin
Posted on: May 8, 2024

Job Description:

About Gartner IT: Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. - We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner. - Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team. - - About the role: Gartner is looking for a well-rounded and motivated lead software developer to join its team which is responsible for developing scalable and configurable data engineering pipelines. These efforts will help us curate and deliver data optimally and efficiently to downstream applications. What you will do:

• Participate in architecture design and implementation of high-performance, scalable, and optimized data solutions. -
• Design, build and automate the deployment of data pipelines and applications to support data scientists and researchers with their reporting and data requirements. -
• Integrate data from a wide variety of sources, including on premise databases and external data sources with rest APIs and harvesting tools. -
• Collaborate with internal business units and data science teams on business requirements, data access, processing/transformation and reporting needs and leverage existing and new tools to provide solutions. -
• Effectively support and partner with businesses on implementation, technical issues, and training on the data lake ecosystem -
• Work with team on managing AWS resources (EMR, ECS clusters, etc.) and continuously improve deployment process of our applications -
• Work with administrative resources and support provisioning, monitoring, configuration, and maintenance of AWS tools. -
• Promote the integration of new cloud technologies and continuously evaluate new tools that will improve the organization's capabilities while leading to lower total cost of operation. -
• Support automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins. -
• Work with the team to implement data governance, access control and identify and reduce security risks. - What you will need : Strong IT professional with 6-9 yrs of experience in software development for data engineering using Python, AWS/ GCP. The candidate should have strong problem-solving skills along with high on ownership and accountability. - Must have:
  • 6-9 years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics and data science
  • Experience working with both structured and unstructured data
  • Strong understanding of OOPS, Design principles and Distributed systems
  • Experience working in different programming languages (Java, python, scala) and experience with version control tools (Git, Subversion)
  • Experience working with Spark/ Hive/HDFS -
  • Experience using automated build systems (CI/CD)
  • Experience of Data Structures and algorithms
  • Experience in AWS/ GCP/ and / or other cloud based solutions Nice to have: -
    • Knowledge of different database technologies (Relational, NoSQL, Graph, Document, Key-Value, Time Series, etc---). This should include building and managing scalable data models
    • Knowledge of TDD/BDD -
    • Experience working with different flavors of SQL and relative database systems
    • Experience in DevOps is good to have Who you are:
      • Graduate/Post graduate in BE/Btech, ME/MTech or MCA is preferred. -
      • Excellent communication and prioritization skills.
      • Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.
      • Owns success - Takes responsibility for successful delivery of the solutions.
      • Mentor and coach junior team members technically and behaviorally align them with Gartner value and culture
      • Strong desire to improve upon their skills in software development, frameworks, and technologies Don't meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles. What you will get:
        • Competitive compensation.
        • Limitless growth and learning opportunities.
        • Ongoing mentorship and apprenticeship; Leadership courses, development programs, technical courses, certification opportunities and more!
        • A collaborative and positive culture - join a diverse team of professionals that are as smart and driven as you.
        • A chance to make an impact - your work will contribute directly to our strategy.
          • A hybrid work environment-enjoy the flexibility of working from home and the energy of collaborating with peers in our dynamic offices.
            • 20+ PTO days plus holidays and floating holidays in your first year.
            • Extensive medical, dental insurance and vision plan.
            • 401K with corporate match, immediate vesting.
            • Health-and-wellness-related allowance programs.
            • Parental leave.
            • Tuition reimbursement.
            • Employee Stock Purchase Plan.
            • Employee Assistance Program.
            • Gartner Gives Charity Match.
              And much more! Who are we? At Gartner, Inc. (NYSE: IT), we deliver actionable, objective insight that drives smarter decisions and stronger performance on an organization's mission-critical priorities. We've grown exponentially since our founding in 1979 and we're proud to have over 19,500 associates globally that support over 15,000 client enterprises in more than 100 countries. What makes Gartner a great place to work? Our teams are composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations. We believe that a diversity of experiences makes us stronger-as individuals, as communities and as an organization. That's why we're recognized worldwide as a great place to work year after year. We've been recognized by Fortune as one of the World's Most Admired Companies, named a Best Place to Work for LGBTQ Equality by the Human Rights Campaign Corporate Equality Index and a Best Place to Work for Disability Inclusion by the Disability Equality Index. Looking for a place to turn your big ideas into reality? Join #LifeAtGartner What we offer: Our people are our most valuable asset, so we invest in them from Day 1. When you join our team, you'll have access to a vast array of benefits to help you live your life well. These resources are designed to support your physical, financial and emotional well-being. We encourage continued personal and professional growth through ongoing learning and development opportunities. Our employee resource groups, charity match and volunteer programs keep you connected to your internal Gartner community and causes that matter to you. Gartner believes in fair and equitable pay. A reasonable estimate of the base salary range for this role is 110,000 USD - 144,900 USD. Please note that actual salaries may vary within the range, or be above or below the range, based on factors including, but not limited to, education, training, experience, professional achievement, business need, and location. In addition to base salary, employees will participate in either an annual bonus plan based on company and individual performance, or a role-based, uncapped sales incentive plan. Our talent acquisition team will provide the specific opportunity on our bonus or incentive programs to eligible candidates. We also offer market leading benefit programs including generous PTO, a 401k match up to $7,200 per year, the opportunity to purchase company stock at a discount, and more.
              The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to affirmatively seek to advance the principles of equal employment opportunity. Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company's career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to -ApplicantAccommodations@gartner.com. Job Requisition ID:85984 By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence. Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy
              For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.

Keywords: Gartner, College Station , Lead Data Engineer, Engineering , Austin, Texas