Agrim

Our journey:Agrim is a fast-growing agri-tech startup building an on-demand B2B Agri-inputs marketplace. Agri-inputs is a$50bn industry spread across Seeds, Agro Chemicals, Fertilizers, Agro-Tools, and Animal Feed. AGRIM hasscaled up rapidly across India, with 10% of the overall customer universe already onboarded on the platform.Having closed our Series A round of funding with Tier-1 investors, we are very well capitalized. Our Founders areIIT/ IIM graduates and ex-entrepreneurs (with successful exits) and we have also built one of the best start-upteams, with senior executives from Tier-1 education institutes, e-commerce companies such as Amazon,Hopscotch, Policy Bazaar, etc. and experienced industry professionals from the agriculture sectorRole ContextAgrim is a rapidly scaling start-up(in business as well as people terms). Like start-ups in this stage, our currentTechnology landscape is built for agility and for Today&rsquo;s needs with the help of Technology partners who cater toour development needs. As we become larger, an in-house technology team becomes imperative to ensure we arebuilt for success in the future. A successful candidate would be someone who is a consummate techie at heart,wants to go on a journey of building and scaling a technology team, a self-starter thrives with empowerment andownership, and has a love for metrics &amp; numbers. If chaos and ambiguity don&rsquo;t scare you, but rather propel you tobring method to madness and ownership of outcomes give you a high, we are the right place for you!Role: Data EngineerAbout The RoleWe are looking for a strong and passionate data engineer with experience in Data Warehouse/BusinessIntelligence/Data Pipelines/API Integration. This is a very high-impact role that will provide a well-roundedperspective on the Business and FinTech at Agrim and brings with it the opportunity to collaborate and interact witha multi-functional group. You will be a part of key initiatives for Agrim which will set the foundation for theCompany&rsquo;s Growth. You will be working on below mentioned Key Initiatives Build and automate ML processes: track, test, measure and deploy ML models in staging and productionenvironments. Build data pipelines to feed machine learning models for real-time and large-scale offline use cases Work closely with data scientists to scale model training and explore new data sources and modelfeatures Responsible for building and maintaining our end-to-end data pipelines from various data sources Implement data modeling concept driven by business requirementsMinimum Qualifications 2+ years of industry experience in software development, data engineering, ML, business intelligence or arelated field. Strong Troubleshooting and problem-solving skills. Production experience programming in Python. Understanding of data management fundamentals and data storage principles. Production experience with one or more major SQL databases. Good communication, collaboration, analytical and problem-solving skills. &bull; Development expertise inUnix-based environmentsPreferred Qualification Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, BusinessIntelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting valuefrom large datasets Experience in large-scale data warehousing and analytics projects, including use of AWS services -Redshift, S3, EC2, etc. Experience with agile development methodologies by following DevOps, Data Ops and Dev Sec Opspractices Experience Integrating Zoho with AWS Service

Work type WFO Gurgaon
 
 Employ type Full-time
 
 Salary budget 15-30LPA

Data engineer(15LPA-30LPA)

Yugen.ai

Data Engineer/Cloud Data Engineer About Yugen Founded in 2020 by ex-Silicon Valley, IIT Alumni with prior experience in Tech Consulting and Product Management, Yugen is an early-stage startup in the Data Science and Machine Learning Engineering space. Simultaneous adoption of Algorithms, Engineering, and Responsible AI will shape the future, and Yugen&rsquo;s vision is to be at the forefront of that trend. We are working towards becoming India&rsquo;s leading player in the Data Science and MLOps consulting space over the next 4-6 years. About the Role and Responsibilities We're looking for Data Engineers who will work hands-on and manage technology projects across multiple client engagements. As a Data Engineer, you will be part of the Engineering and Technology function and eventually play a central role in building our MLOps platform. Your key responsibilities will be to - ● Translate business requirements into scalable technical solutions ● Design, build and manage Data Ingestion, transformation and exploration pipelines designed for high throughput/low latency ● Deploy a range of data engineering pipelines into production ● Collaborate with other ML Engineers and Data Scientists during System Design &amp; implementation/maintenance of Feature Stores and Model Monitoring ● Be result oriented and emphasise on on-time delivery of projects ● Communicate potential roadblocks and trade-offs between performance and complexity upfront ● Mentor other Data Engineers and enable their growth Yugen is currently an early-stage startup with a fast-growing client portfolio. We create scalable and reliable ML Systems and therefore Engineering is an extremely crucial part of our work. We are strongly committed to the &lsquo;Every promising model should face the test of reality&rsquo; philosophy. Key Qualifications Must Haves ● Knowledge and experience of deploying and maintaining large scale advanced systems in production environments ● 2+ years of hands on experience in building Distributed Computing - Spark/PySpark, Scala and Kafka ● Strong programming skills in Python &amp; SQL ● Experience in handling architectural and design considerations such as performance, scalability, reusability and flexibility issues ● 2+ years of hands-on experience in Cloud computing platforms (any one of AWS/Azure/GCP) ● Workflow management such as Airflow ● Linux environment, SQL &amp; NoSQL databases and Shell scripting ● Clear understanding of Git/version control Desirable ● Hands-on experience on deploying ML models ● Knowledge of feature stores ● Knowledge of deployments in Kubernetes containers

Work type WFH
 
 Employ type Full-time
 
 Salary budget Max 25L

Data engineer(Max 25L)

American Express

You Lead the Way. We’ve Got Your Back.At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether we’re supporting our customers’ financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly redefining what’s possible — and we’re proud to back each other every step of the way. When you join #TeamAmex, you become part of a diverse community of over 60,000 colleagues, all with a common goal to deliver an exceptional customer experience every day. We back our colleagues with the support they need to thrive, professionally and personally. That’s why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually. You won’t just shape the world of software.You’ll shape the world of life, work and play. Our Software Engineers not only understand how technology works, but how that technology intersects with the people who count on it every day. Today, innovative ideas, insight and new perspectives are at the core of how we create a more powerful, personal and fulfilling experience for all our customers. So, if you’re interested in a career creating breakthrough software and making an impact on an audience of millions, look no further. You won’t just keep up, you’ll break new ground. There are hundreds of opportunities to make your mark on technology and life at American Express. Here’s just some of what you’ll be doing: - Taking your place as a core member of an agile team driving the latest development practices - Writing code and unit tests, working with API specs and automation - Identifying opportunities for adopting new technologies.Focus:Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.Organizational Context:Member of a product engineering or delivery and integration team reporting to a Senior Engineer, Engineering Director or Director Product Delivery &amp; Integration.How will you make an impact in this role?Software Development

Intermediate to advance level ability in software development, such coding assignments

Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)

Participate in code reviews and automated testing

Debug basic software components and identify code defects for remediation

Enable the deployment, support, and monitoring of software across test, integration, and production environments

Automate deployments in test or production environments

Automatically scale applications based on demand projections

Leadership

Demonstrate increased self-reliance to achieve team goals

Influence team members with creative changes and improvements by challenging status quo and demonstrating risk taking

Range of Impact/Influence:

Accountable for team completing work you’re leading and work you are doing as agreed upon

Accountable to team for delivery of quality work

Description:American Express is looking for energetic, high-performing software engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial team that enables batch/ real-time analytical solutions leveraging transformational technologies (Hadoop/BIG DATA, Data Science - R, Python, Scala, SQL, UNIX , Shell Scripting) to deliver innovative solutions across multiple lines of business&rsquo;s. Position requires a bachelor’s or higher degree in Computer Science, Information Systems, Engineering or related field. Good experience in data programming and applications systems design and architecture is required. 

Develops and tests software, including ongoing refactoring of code &amp; drives continuous improvement in code structure &amp; quality

Primary focus is spent writing code, API specs, conducting code reviews &amp; testing in ongoing sprints or doing proof of concepts/automation tools

Applies visualization and other techniques to fast-track concepts

Functions as a core member of an Agile team driving User story analysis &amp; elaboration, design and development of software applications, testing &amp; builds automation tools

Works on a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business priority

Identifies opportunities to adopt innovative technologies

Embodies rebel with a cause mentality by looking beyond the obvious for continuous improvement opportunities.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

Qualifications:

Support the Compliance and Operations Risk big data delivery team in India to lead and assist in the design and actual development of applications.

Responsible for specific functional areas within the team, this involves project management and taking business specifications.

The individual should be able to independently run projects/tasks delegated to him.

Responsible for analysis, design, development, testing, and implementation of system applications.

Develop and maintain project related documentation,

Provide system support and user support/training/communication for implemented applications.

Technical Skills:

Bachelor’s degree in engineering or Computer Science or equivalent OR master’s in computer applications or equivalent

3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data

Expert on Distributed ecosystem including Map-Reduce, Hive, Spark (core, SQL and pyspark)

Hands-on experience with programming using Core Java or Python/Scala

Expert on Hadoop and Spark Architecture and its working principle 

Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data

Experience in UNIX shell scripting

Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have

Ability to design and develop optimized Data pipelines for batch and real time data processing

Knowledge of cloud platforms like AWS, GCP is good to have

Provides advanced knowledge of technical and functional principles.

Should have experience in analysis, design, development, testing, and implementation of system applications

Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.

Experience with GitHub/Bitbucket and leveraging CI/CD pipelines

Creative problem solving (Innovative)

Excellent technical and analytical aptitude

Self-starter with a curiosity and appetite for new technology,

Teamwork &amp; ability to multi-task

Excellent communication skills

Ability to influence and lead others

Ability to coach and mentor,

Excellent Project management skills.

Results driven

Willingness to understand the business and participate in discussions around project requirements

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, age, or any other status protected by law. 

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

Engineer II - Big Data - Hadoop/Pyspark

Mastercard

Our PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion (https://www.mastercard.us/en-us/vision/who-we-are/diversity-inclusion.html) for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team one that makes better decisions, drives innovation and delivers better business results.Job TitleLead Software Engineer - .net/C# developerMastercard is the global technology company behind the world’s fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.The Data &amp; Services team is a key differentiator for Mastercard, providing the cutting-edge services that help our customers grow. Focused on thinking big and scaling fast around the globe, this agile team is responsible for end-to-end solutions for a diverse global customer base. Centered on data-driven technologies and innovation, these services include payments-focused consulting, loyalty and marketing programs, business Test &amp; Learn experimentation, and data-driven information and risk management services.As a Lead Software Engineer on the New Product Engineering team at Mastercard,You will lead the development of new, early-stage products in collaboration with cross-functional teams to ensure solutions drive customer value, and scale to meet customer demand. You will lead the technical design from the outset and create high-performance analytic applications based on data sets measured in the billions of transactions and front-end visualizations to unleash the value of big data. The reward is well worth the effort as an elegant solution can create millions of dollars of profit in a single run.You will lead the end-to-end development of applications that sit atop vast datasets, including Mastercard transactions, and those gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge is to create high-performance algorithms, cutting-edge analytical techniques, compelling visualizations, and intuitive workflows that allow our users to derive insights from big data that in turn drive their businesses.Engineers work in small, flexible teams. Every team member contributes to feature design, building, and testing. The range of work you encounter varies from front-end web development to writing server-side calculation code to database work. There are no rigid organizational structures at Mastercard; each team uses processes that work the best for that team&rsquo;s members and projects.This position is based out of our new Pune, India office, but will be working closely with our US teams based in Arlington, VA and New York City, NY.Role• Lead state of the art design and development of new, complex technical products from inception to release with high quality• Continuously experiment, innovate, and identify technologies and approaches to deal with larger and larger data sets faster and faster• Collaborate closely with cross-functional teams to design scalable solutions which drive customer value• Lead with an agile mindset and pivot fast and often as new information surfaces• Keep senior stakeholders informed of progress and incorporate input into technical decisions• Build and lead high-performing development teams and mentor junior teammates• Play a leading role in shaping office culture and growing the New Product Engineering team in Pune• Play a key role in shaping the direction of engineering processes through working on a small team empowered to organize and run the team as they see fit• Drive technical direction of product roadmap• Develop features and new platform solutions that are well designed and maintainable.• Identify engineering needs to scale platform solutions to meet customer demandAll about you/Ideal candidate for qualification• Mandatory skills - JavaScript and JavaScript web frameworks such as React/Redux, Angular, etc• Experience scoping, designing, building, deploying, and releasing new B2B products and platforms• Solid technical foundation in full stack development, including• Full stack solution architecture• Web technologies and server-side technologies• C# and object-oriented technologies• Modular design using and creating single-responsibility services and API• PCF application development• Preferred - Data engineering using Impala, Hive, HDFS and other big data technologies• Experience using R• Proven track record of quickly learning and successfully using new technologies and development approaches• Experience solving and implementing scalable solutions to solve complex problems• Strong focus on architecting solutions to drive customer value• Ability to proactively identify and mitigate technical and operational risks• Experience in working in agile methodologies and environment• Full stack engineering experience using a variety of technical stacks in production environments• Passion for analytical / quantitative problem solving• Experience in CI/CD and strong focus on the engineering methodology• Motivation, creativity, self-direction, and ability to lead small, high-performing product teams• Ability to provide technical mentorship to the team with a focus on improving technical and code quality and skills• Superior academic record with a degree in Computer Science or related technical field• Prior experience leading a team or mentoring other engineers, both technically and professionally• Strong written and verbal English communication skillsMastercard is an equal opportunity employer that values diversity and inclusion. Applicants will be considered and treated without regard to gender, gender identity, race, color, ethnicity, national origin, religion, sexual orientation, veteran or disabled status, or any other characteristic protected by applicable lawCOVID-19 ConsiderationsIn many locations, we’ve implemented a virtual hiring process and continue to interview candidates by video or phone. In addition, in our NYC offices, as required by law, only individuals who have been fully vaccinated against COVID-19 will be permitted inside Mastercard offices unless a reasonable accommodation has been approved in advance.Corporate Security ResponsibilityAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

Abide by Mastercard’s security policies and practices;

Ensure the confidentiality and integrity of the information being accessed;

Report any suspected information security violation or breach, and

Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Requisition ID: R-165288

Lead Software Engineer - .net/C# developer

Our PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion (https://www.mastercard.us/en-us/vision/who-we-are/diversity-inclusion.html) for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team one that makes better decisions, drives innovation and delivers better business results.Job TitleSoftware Engineer IIAt Mastercard, our industry expertise is enhanced by our commitment to being a force for good in the world and to doing well by doing good. Mastercard relies on our global workforce to help us achieve our goal of building a sustainable, inclusive global economy. The Mastercard Way encourages us, connects us with the behaviors that represent the essence of not only what we do but who we are as an organization. Cultivating an environment for all employees that respects their individual strengths, views and experiences drives a global and collaborative culture of inclusion and sense of belonging.The Mastercard Consolidated Billing System (MCBS) team under the financial solutions program has an exciting opportunity for a Software Development Engineer. Financial Solutions provides Mastercard and its customers with a fully automated and scalable system that delivers timely pricing and billing solutions as well as accurate stakeholder reporting. In this role you will be responsible for designing and developing billing programs to support Mastercard’s billing and enhance customers billing experience through simplification of the billing structures.MasterCard software engineering teams leverage Agile development principles, advanced development and design practices, and an obsession over security, reliability, and performance to deliver solutions that delight our customers. We&rsquo;re looking for talented software development engineers to develop advanced technologies and applications that are revolutionizing payments.

Are you passionate about software engineering?

Do you enjoy seeing the impact your code has on a wide range of customers?

Do you want to work for a company that offers above and beyond benefits including paid parental leave, flexible work hours, gift matching, and even volunteer incentives while encouraging your own professional learning and development?

Do you thrive in a place where you are continuously learning more while growing your skills and career?

Do you want to join a Company that offers a competitive benefits-and rewards program that attracts, develops and retains the most talented employees around the world?

Do you want to join an inclusive culture where employees, in all their diversity, feel valued, respected and who can bring their authentic selves to work? Learn more at Mastercard’s Corporate Sustainability Report.

Role:• Bachelor’s or Master’s in CS, Data Science, or a related STEM field• Extensive Java/Scala development experience.• Develop high quality, secure and scalable data pipelines using Spark, Java/python on Spark, Apache Nifi &amp; object storage.• Leverage new technologies and approaches to innovate with increasingly large data sets.• Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.• Understand, implement, and enforce Software development standards and engineering principles in the Big Data space.• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.• Perform assigned tasks and production incident independently.About You:• Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment• Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage• Experience of building Nifi pipelines• Strong experience with Spark Processing engine.• Experience in Kafka and PCF (Pivotal Cloud Foundry)• Experience analyzing data to discover opportunities and address gaps.• Experience of working with Databases like Oracle and have strong SQL knowledge• Strong analytical skills required for debugging production issues, providing root cause, and implementing mitigation plan• Strong communication skills - both verbal and written• Ability to multi-task across multiple projects, interface with external / internal resources• Ability to be high-energy, detail-oriented, proactive, and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results• Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement• Flexibility to work as a member of a matrix based diverse and geographically distributed project teamsCOVID-19 ConsiderationsWe value the safety of each member of our community because we know we’re all in this together. In many locations, which may change over time, we’ve implemented a virtual hiring process and continue to interview candidates by video or phone. In addition, in some locations, only individuals who have been fully vaccinated will be permitted inside Mastercard offices until further notice.In the US, Mastercard is a government contractor, which may legally require most Mastercard employees to be vaccinated unless a verified approved medical or religious exemption is granted. Further, we are currently making every effort towards having employees return to work in the office 2 days per week, if that makes sense for their team. Everyone must be vaccinated to enter Mastercard offices at this time. Therefore, we expect all candidates to be vaccinated or to be approved for a medical or religious accommodation prior to commencing work at Mastercard.Corporate Security ResponsibilityAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

Abide by Mastercard’s security policies and practices;

Ensure the confidentiality and integrity of the information being accessed;

Report any suspected information security violation or breach, and

Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Requisition ID: R-167831

Software Engineer II

Our PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion (https://www.mastercard.us/en-us/vision/who-we-are/diversity-inclusion.html) for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team one that makes better decisions, drives innovation and delivers better business results.Job TitleSenior Software EngineerJob Description SummaryOverviewMastercard is a global technology company behind the world’s fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.As a Sr. Data Engineer in Data Platform and Engineering Services, you will have the opportunity to build high performance data pipelines to load into Mastercard Data Warehouse. Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems.Role• Develop high quality, secure and scalable data pipelines using spark, Java/Scala on object storage and Hadoop• Follow MasterCard Quality Assurance and Quality Control processes• Leverage new technologies and approaches to innovating with increasingly large data sets• Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems• Perform assigned tasks and production incident independently• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiencyAll About You• 5 to 8 years of experience in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment• Experience working in Unix environment with shell scripting• Strong Data Analysis skills.• Experience of working on Nifi will be an added advantage• Experience of building data pipelines through Spark with Java/Scala on Hadoop or Object storage is added advantage• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge• Experience of working with APIs will be an added advantage• Experience of working in Agile teams• Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan• Strong communication skills - both verbal and written and strong relationship, collaboration skills and organizational skills• Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members• Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results• Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement• Flexibility to work as a member of a matrix based diverse and geographically distributed project teamsCOVID-19 ConsiderationsIn many locations, we’ve implemented a virtual hiring process and continue to interview candidates by video or phone. In addition, in our NYC offices, as required by law, only individuals who have been fully vaccinated against COVID-19 will be permitted inside Mastercard offices unless a reasonable accommodation has been approved in advance.Corporate Security ResponsibilityAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

Abide by Mastercard’s security policies and practices;

Ensure the confidentiality and integrity of the information being accessed;

Report any suspected information security violation or breach, and

Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Requisition ID: R-170120

Senior Software Engineer

Our PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion (https://www.mastercard.us/en-us/vision/who-we-are/diversity-inclusion.html) for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team one that makes better decisions, drives innovation and delivers better business results.Job TitleLead, Data EngineerWho is Mastercard?Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.OverviewThe Data Warehouse team is looking for a Big Data Lead Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The Hadoop Data Warehouse is being used by various groups to derive insights, perform Machine Learning and Data Science activities which in turn supports various revenue generating initiatives across the organization.Role• Develop high quality, secure and scalable data pipelines using spark, Scala/ python/ Java on Hadoop or object storage.• Develop pipelines using SSIS or Alteryx or Spark leveraging big data sources.• Design and architect data flow schemes in Hadoop environment which can be scalable, repeatable and eliminate time consuming steps.• Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.• Understand,implement and enforce Software development standards and engineering principles in the Big Data space.• Work closely with business stakeholders and embedded engeering teams within business teams in a collaborative manner to help them build scalable products in quick time.• Leverage new technologies and approaches to innovating with increasingly large data sets.• Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems.• Perform assigned tasks and production incident independently.• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.All About You• 10-16 years of experience in Data Warehouse related projects in product or service-based organization• Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data Hadoop environment and / or SQL Server• Expertise in Data Engineering using Microsoft stack using SSIS and Azure services.• Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge• Experience of working on real time data flow system, NiFi and Kafka will be an added advantage• Experience of working on automation in data flow process in a Big Data environment.• Experience of working in Agile teams• Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan• Strong communication skills - both verbal and written and strong relationship, collaboration skills and organizational skills• Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members• Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results• Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement• Flexibility to work as a member of a matrix based diverse and geographically distributed project teamsCOVID-19 ConsiderationsIn many locations, we’ve implemented a virtual hiring process and continue to interview candidates by video or phone. In addition, in our NYC offices, as required by law, only individuals who have been fully vaccinated against COVID-19 will be permitted inside Mastercard offices unless a reasonable accommodation has been approved in advance.Corporate Security ResponsibilityAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

Abide by Mastercard’s security policies and practices;

Ensure the confidentiality and integrity of the information being accessed;

Report any suspected information security violation or breach, and

Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Requisition ID: R-175858

Lead, Data Engineer

Amdocs

Who are we?
In one sentence
What will your job look like?

Design, Create, Enhance &amp; Support data pipelines for different domain using Big Data Technologies.

In charge of Data Ingestion, Transformation, Data Models, Schemas, Metadata, And Workload Management

Perform Development &amp; Deployment tasks, should be able to Code, Unit Test &amp; Deploy.

Perform application analysis and propose technical solution for application enhancement, optimizing existing ETL processes etc.

Handle and resolve Production Issues (Tier 2 &amp; weekend support)

Create necessary documentation for all project deliverable phases

Collaborate with multi discipline interfaces: dev team, business analysts, Infra, information security, end users.

All you need is...

 4+ years of Big Data architecture and other relevant Big data tools like Cloudera HDP , Snowflake, ETL tools and more

Strong technical orientation

Strong experience in Object-oriented/Object function scripting using languages such as R, Python, Scala, or similar.

Strong ability to design, build and manage data pipelines in Python and related technologies.

Hands on in SQL, Unix &amp; advanced Unix Shell Scripting.

Experience in working with Data Governance, Data Quality, and Data Security teams and standards.

Superb communication and collaboration skills

Independent and Self-learning attitude

Why you will love this job:

Software Engineer - Data Engineer (3-6 Yrs) (Development)

Freecharge

Freecharge a subsidiary of Axis Bank Limited founded in 2010, is a Fin-Tech organisation revolutionizing Financial Products through technology.

At our core, we&rsquo;re a creative company. Ideas and pixels is where we live and we love building magical products that make our users feel &rsquo;wow&rsquo;. At Freecharge, you&rsquo;ll have the chance to do the best work of your life. We&rsquo;re on a journey to build something new, something different and something innovative &amp; that requires passion to build such incredible products.

Come join us and shape the future of Fin-Tech.

Do You Make The Cut?

We are looking for a passionate and experienced Big Data Engineer for driving the design and development of core platform frameworks with the mega knowledge of Spark, Scala and Kafka Streams that enable the delivery and construction processes for the Data Management, Data Discovery and Analytics group, and using emerging big data technologies.

Title : Data Engineer - Big Data

Location : Gurugram

Experience : 1-3 Yrs.

Education : Bachelor&rsquo;s / Master&rsquo;s in Software Engineering

 Gather and process raw data at scale.
 Design and develop data applications using selected tools and frameworks.
 Read, extract, transform, stage, and load data to selected tools and frameworks.
 Build and execute data warehousing, mining, and modelling activities using agile development techniques.
 Perform tasks such as writing scripts, calling APIs, write SQL queries, etc.
 Deploy and monitor products on AWS Cloud platform
 Monitoring data performance and modifying infrastructure as needed.
 Developing ETL flows based on Hadoop/Big Data stack technology : Apache Nifi, Hive, Spark, Kafka
 Troubleshooting and performance optimization for data processing flows, data models.

Sounds Like You?
 1+ years of Big data development experience with working proficiency in Java/Scala/Python to write data pipelines and data processing layers.
 Strong in Data Structures &amp; Algorithms, Analytical, and problem-solving skills.
 Management of the Hadoop cluster, with all included services.
 Proficiency with Spark, Hadoop v2, MapReduce, HDFS.
 Experience with building stream-processing systems, using solutions such as Storm, or Spark-Streaming.
 Experience with the integration of data from multiple data sources.
 Experience with SQL, NoSQL databases.
 Experience with various messaging systems, such as Kafka, or RabbitMQ.
 Experience with confluent packages like Kafka connect, schema registry.
 Experience with Cloudera/MapR/Hortonworks.
 Experience with AWS big data solutions.
 Good knowledge of Big Data querying tools, such as Pig, Hive or Impala
 Knowledge of various ETL techniques and frameworks, such as Flume

(ref:hirist.com)

Freecharge - Software Development Engineer - Big Data

#ComeAsYouAre Get To Know Us First!Freecharge a subsidiary of Axis Bank Limited, is a Fin-Tech organization revolutionizing Financial Products through technology. At our core, we’re a creative company. Ideas and pixels is where we live and we love building magical products that make our users feel ‘wow’. At Freecharge, you&rsquo;ll have the chance to do the best work of your life. We’re on a journey to build something new, something different and something innovative &amp; that requires passion to build such incredible products. Come join us and shape the future of Fin-Tech.Do You Make The Cut?Engineering Leaders at Freecharge need to be technical leaders and motivators who are comfortable leading teams in a dynamic environment. The ideal candidate is self-motivated and detail oriented with experience working in a fast-pace software development environment.ResponsibilitiesCreating Data Pipelines with any of the Existing Sources in our Systems
Hands-on at Tableau and Python
Creating Data Platform for any Data related activities
Single source of contact for any of the data related queries
Single source of truth for any DBAT products data, and any discussions with BIU
Handling both structured and unstructured data sources
Providing the Detailed analysis of products built by us
Handling various logs flowing from different products
Creating the capabilities of AI/ML Solutions built in Future
Any AI/ML solutions require the data and Data Engineering team handles all their data requirements
Creating the Data Dictionary of all different sources
The incumbent will be working on below technologies :
o AWS Data Lakeo AWS Athenao Kafkao AWS Kinesiso AWS Aurorao AWS Document DBo Apache NiFio Apache Sparko Apache Zookeepero AWS S3o AWS EMR

Data Engineer

Teradata

Our CompanyTeradata is the connected multi-cloud data platform for enterprise analytics company. Our enterprise analytics solve business challenges from start to scale. Only Teradata gives you the flexibility to handle the massive and mixed data workloads of the future, today.The Teradata Vantage architecture is cloud native, delivered as-a-service, and built on an open ecosystem. These design features make Vantage the ideal platform to optimize price performance in a multi-cloud environment.Title: Senior Technical Trainer and Developer / Cloud Specialist



Responsibilities:

Design, develop, and deliver technical enablement courses (virtual and live instructor-led training / workshops with hands-on labs in Cloud environments) in support of Vantage Cloud SaaS (AWS, Google and Azure) with cloud native services, cloud migration tools, and other Teradata Vantage capabilities and features optimized for cloud modernization. Primary audiences include global technical consultants implementing services such as cloud migrations, data/solution engineers, and post-sales customer-facing roles as well as for customers and partners (DevOps, DBAs, Data Engineers, Data Scientists)

Develop cloud native services (AWS preferred) + Teradata Vantage end user, cloud migration and/or DBA courseware for virtual instructor-led training, e-learning and other forms of blended learning

Develop and deliver various Teradata courses especially Vantage on AWS and open to learn new technical tools and topics related to Vantage, Cloud, Cloud Migration, Analytics, Workload Management, Physical Database Design, Database Administration or any Consulting Service Portfolio trainings, etc. For example: QueryGrid, Streams, Native Object Store, Teradata Parallel Transporter, Data Mover, Teradata Advanced SQL Engine, Viewpoint, In-Database analytics, Vantage Analytics Library

Design creative hands-on learning experiences that can be utilized just-in-time and provide on-the-job performance support such as microlearning videos and recorded demos for eLearning courses

Assist with creating and maintaining technical curriculum for Teradata consultants, partners and customers

Maintain close working relationships with the environment team and assist them in streamlining the systems/instances for training delivery

Build and cultivate relationships with Teradata leaders, Subject Matter Experts (SMEs) and stakeholders, including consulting with them to understand product release contents/timelines and needs and develop appropriate learning deliverables to develop identified skills and knowledge

Be adaptable to change, self-motivated, and able to act independently to prioritize workload and meet deadlines.

Challenge existing models and processes to design innovative learning that can be used just-in-time and provide on-the-job performance support. 

Qualifications:

6-8+ years of experience developing and delivering technical courses to one or more of these types of audiences: data engineers, solution architects, devops, database and cloud administrators, cloud migration engineers, consulting services, technical sales, presales architects, customer success managers, data scientists, business analysts, citizen data scientists

3-6+ years of experience coding in SQL language and either Python or R where you are proficient creating courseware teaching SQL and either Python or R

Domain expertise in Cloud Technology - cloud native services (such as Glue, Data Factory, Dataflow, Kubernetes, Docker, Databricks, Redshift), object stores, scaling, building cloud systems, and snapshots),

Working knowledge of Databases. If not Teradata, then Oracle, SQL Server, Postgress, Presto, MySQL

Experience with ETL tools (e.g. Glue, Data Factory, Dataflow, Teradata Data Mover, Teradata Parallel Transporter)

Working knowledge of Cloud services (Compute, Storage, Networking and Security)

A demonstrated ability to adapt to new database tools and technologies and learn quickly

Proficient in MS Office Suite and Office 365 applications, particularly in creating courseware in PowerPoint

A demonstrated ability to work cross-functionally with multiple teams and stakeholders

Strong time management, communication and writing skills

Strong critical thinking and analytical abilities

Excel in learning quickly, working independently, and as part of a team

Ability to travel up to 50% of the time including International travel (currently all courses are taught virtually)



Teaching virtual training using Webex Training Center or similar software

Expertise in big data tools such as Kafka, Spark, Presto, Airflow

Data Science, data analytics, H20 AI/AutoML and tools such as Tableau, PowerBI, JupyterHub

Virtualization (VMware)

Experience with Teradata Vantage ecosystems and cloud lab environment providers

Experience using software for recording microlearning videos (e.g. Camtasia), simulation recordings (e.g. Captivate, Articulate 360)

Senior Technical Trainer and Developer / Cloud Specialist

Our CompanyTeradata is the connected multi-cloud data platform for enterprise analytics company. Our enterprise analytics solve business challenges from start to scale. Only Teradata gives you the flexibility to handle the massive and mixed data workloads of the future, today.The Teradata Vantage architecture is cloud native, delivered as-a-service, and built on an open ecosystem. These design features make Vantage the ideal platform to optimize price performance in a multi-cloud environment.Job Location :- Pune/ Mumbai Educational Requirements: Bachelors Degree from a reputed Educational Institute.
Post-graduate degree is a plus.Technical Skill Set Required:- Should have 4-6 years of IT experience and minimum 3 years of Informatica experience
Preferably should have worked on Informatica 10.x 
Preferably should have lead a team of 2 to 15 people
Should have worked on at least 4 end to end DW Projects
Should be able to create ETL Design Documents &amp; Mapping Specification Documents
Should be able to understand Data Models
Should have enough experience to work on UNIX &amp; Shell Scripting
Should have strong PL/SQL &amp; SQL Tuning skills
Exposure to Github/QA/Jenkins/Python/Hadoop is preferable.
Teradata Query writing
Should have exposure to Incident Analysis and in support project
Should be willing to work in 24/7 support environment ( Mandatory).
Nice to have SSIS Development, Autosys, ITIL knowledgeKey Areas of Responsibility: This individual will be responsible for solution design, integration, data sourcing and transformation, database design and development (logical / physical) and tool implementation related to data warehousing (responsibility level will be commensurate with the position level and will begin in a learning mode).
Interface with Teradata engineering staff as needed to resolve complex technical issues
Specify, demonstrate and scope Teradata solutions that deliver business value to the client / prospect.
Experience in writing the SQL queries using Oracle/Teradata
Transfer knowledge and expertise to other TERADATA professional services associates.
Provide technical expertise to data warehouse clients that will contribute to innovative business solutions.
Flexible in working in off-working hours (shift work) including 24X7 Support if requiredProfessional Development Offered: Training on the Teradata database
Opportunities to work on high-profile international projects

Informatica Developer

Our CompanyTeradata is the connected multi-cloud data platform for enterprise analytics company. Our enterprise analytics solve business challenges from start to scale. Only Teradata gives you the flexibility to handle the massive and mixed data workloads of the future, today.The Teradata Vantage architecture is cloud native, delivered as-a-service, and built on an open ecosystem. These design features make Vantage the ideal platform to optimize price performance in a multi-cloud environment.Role: MDM DeveloperJob Location: Mumbai/Pune/BangaloreEducational Requirements:• Bachelor’s degree in Computer Science from a reputed Educational Institute.
• Post-graduate degree would be a plus.Technical Skill Set Required: -• Should have 3-8 years of IT experience and 3-6 years of working experience in end to end MDM implementations (Preferably TMDM, Informatica MDM, IBM MDM, JDA ABPP)
• Strong Programming Concepts with coding experience using Object Oriented Languages like JAVA/C++/Python.
• Web UI building experience for Data Management Applications (using the typical MVC model), Angular, Angular Material, Covalent, REST APIs.
Experience in XML, XPath, Java, JavaScript, JQuery, Webservices, shell scripting
• Strong RDBMS Concepts. Should have strong PL/SQL &amp; SQL Tuning skills. Teradata database experience desired.
• Should be able to understand the functional requirements and relate them to Logical Data Model.
• Enterprise Application Integration Architecture knowledge. Configuration and Setup of Application Server Clusters
• Knowledge and hands-on experience on Cloud First Party Data Services from CSPs like AWS, AZURE, GCP
• Operational knowledge of Application Servers tomcat, WebLogic, Nginx.
• Experience in 3rd Party DQ Tools like LOQATE, TRILLIUM, Talend, IDQ• Experience in incident and problem management.
• Ability to work independently in terms of understanding the design specs and translate them to work-products/deliverables and execute activities with minimal guidance.
• Excellent verbal and written communications.
• Should be flexible to work in shifts and from client location
• Should have experience in Teradata tools and utilities like Bteq, TPT, Fload , Mload etc.
• Exposure to GitHub/QA/Jenkins/Python is preferable
• Should have played the Technical Lead on at least 1 project
• Should have led a team of 3 - 6 people during one of these projects
• Should be able to do project estimations
• Should be able to do some amount of Project Management activities
• Should be able to create MDM Architecture Document
• Should be able to understand Data Models &amp; make modifications if necessary
• Should have enough experience to work on UNIX &amp; Shell Scripting
• Should have excellent problem solving and legacy code reading and debugging skills
• Should be hardworking and self-driven to learn continuously
• Integrated Development Environments (IDEs): Rational Software Architect, Eclipse, Visual Studio Code

Key Areas of Responsibilities:
• This individual will be responsible for solution design, integration, data sourcing and Master Data Design and development /Coding.
• Interface with Teradata engineering team as needed to resolve complex technical issues
• Specify, demonstrate, and scope Teradata solutions that deliver business value to the client / prospect.
• Transfer knowledge and expertise to other TERADATA professional services associates.
• Leadership, status monitoring, and mentoring of the other “MDM Consultants” in the team.
• Should be able to understand Project requirements and work independently
• Candidate should support any technical issue/conflicts reported by the client in a timely manner.
• Candidate must follow coding standards as prescribed by the client if it exists or else follow Teradata standards.
• Candidate must support internal and external audits as required.
• Align and adapt to Agile and SDLC technical solution delivery methodology as followed by the client.
• Come-up with solutions for complex issues with articulation of multiple possible options with their pros and cons and recommending one with proper reasoning (all levels).
• Do performance analysis and optimization on specific functionality
• Directly communicate with business end users and, quickly adapt and learn the functional terms that are used.
• Build references architectures, how-tos, and demo applications for customer
Professional Development Offered:• Training on Teradata database
• Training on Teradata applications (MDM/RDM/CI/VCX/CIM) that run on top of Teradata database.
• Opportunities to work on high-profile international projects
• Opportunities to work on data mastering and reference data problems across multiple verticals

Lowe's

Data Engineer

Job Description


The primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying integrated business and/or enterprise infrastructure or application solutions within various computing environments. This role facilitates the implementation and maintenance of business and enterprise Data or Platform solutions to ensure successful deployment of released applications.

Qualifications

• Bachelor&rsquo;s Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
• 2 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

• Master&rsquo;s Degree in Computer Science, CIS, or related field
• 2 years of IT experience developing and implementing business systems within an organization
• 4 years of experience working with defect or incident tracking software
• 4 years of experience with technical documentation in a software development environment
• 2 years of experience working with an IT Infrastructure Library (ITIL) framework
• 2 years of experience leading teams, with or without direct reports
• Experience with application and integration middleware
• Experience with database technologies
Data Engineering
• 2 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)
BI Engineering
• Expertise in MicroStrategy/Power BI/SQL, Scripting, Teradata or equivalent RDBMS, Hadoop (OLAP on Hadoop), Dashboard development, Mobile development (specific to the BI Engineering role)
Platform Engineering
• 2 years of experience in Hadoop, NO-SQL, RDBMS or any Cloud Bigdata components, Teradata, MicroStrategy (specific to the Platform Engineering role)
• Expertise in Python, SQL, Scripting, Teradata, Hadoop utilities like Sqoop, Hive, Pig, Map Reduce, Spark, Ambari, Ranger, Kafka or equivalent Cloud Bigdata components (specific to the Platform Engineering role)

Job ID

2287090BR

Job Category

Technology 

Employment type

Full time 

Job Classification

Open Office 

Location

Bangalore

Data Engineer_DACI Product

Lead Data Engineer

Job Description


The primary purpose of this role is to provide consultation and technical advice on translating business requirements and functional specifications into logical program designs. This includes facilitating the implementation and maintenance of complex business and enterprise data solutions to ensure successful deployment of released applications. This role serves as a technical expert for project teams throughout the implementation and maintenance of business and enterprise Data or Platform solutions. In addition, this role personally develops and delivers modules, stable application systems, and integrated enterprise Data or Platform solutions within various computing environments.

Qualifications

• Bachelor&rsquo;s Degree in Engineering, Computer Science, CIS, or related field
• 7 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 6 years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

• Master&rsquo;s Degree in Computer Science, CIS, or related field
• 6 years of IT experience developing and implementing business systems within an organization
• 6 years of experience working with defect or incident tracking software
• 6 years of experience writing technical documentation in a software development environment
• 4 years of experience working with an IT Infrastructure Library (ITIL) framework
• 4 years of experience leading teams, with or without direct reports
• 6 years of experience working with source code control systems
• Experience working with Continuous Integration/Continuous Deployment tools
• 6 years of experience in systems analysis, including defining technical requirements and performing high level design for complex solutions
Data Engineering
• 4 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• 2 years of experience playing a lead role in projects (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)
BI Engineering
• 3 years of experience in MicroStrategy (specific to the BI Engineering role)
• 1 year of experience in OLAP on Hadoop or any Cloud BI components (specific to the BI Engineering role)
• 2 years of playing a lead role in projects (specific to the BI Engineering role)
• Expertise in MicroStrategy/Power BI/SQL, Scripting, Teradata or equivalent RDBMS, Hadoop (OLAP on Hadoop), BI Architecting, Dashboard development, Mobile development (specific to the BI Engineering role)
Platform Engineering
• 4 years of experience in Hadoop, NO-SQL, RDBMS or any Cloud Bigdata components, Teradata, MicroStrategy (specific to the Platform Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, MicroStrategy, Oracle, MySql, SQL Server, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Platform Engineering role)Lowe&rsquo;s Technology organization believes that in-person collaboration is highly effective and helps build relationships and strengthens our culture. As such, we are leveraging an Open Office approach in how we work, meaning our tech associates will leverage time in the office to focus on highly collaborative activities as well as some remote / work from home time for autonomous endeavors. Each role has different business-driven collaboration needs that will require in-office presence.

Job ID

2056415BR

Job Category

Technology 

Employment type

Full time 

Job Classification

Open Office 

Location

Bangalore

Lead Data Engineer_Bigdata_DACI Product

Lead Data Engineer

Job Description

The primary purpose of this role is to provide consultation and technical advice on translating business requirements and functional specifications into logical program designs. This includes facilitating the implementation and maintenance of complex business and enterprise data solutions to ensure successful deployment of released applications. This role serves as a technical expert for project teams throughout the implementation and maintenance of business and enterprise Data or Platform solutions. In addition, this role personally develops and delivers modules, stable application systems, and integrated enterprise Data or Platform solutions within various computing environments.

Qualifications

• Bachelor&rsquo;s Degree in Engineering, Computer Science, CIS, or related field
• 7 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 6 years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

• Master&rsquo;s Degree in Computer Science, CIS, or related field
• 6 years of IT experience developing and implementing business systems within an organization
• 6 years of experience working with defect or incident tracking software
• 6 years of experience writing technical documentation in a software development environment
• 4 years of experience working with an IT Infrastructure Library (ITIL) framework
• 4 years of experience leading teams, with or without direct reports
• 6 years of experience working with source code control systems
• Experience working with Continuous Integration/Continuous Deployment tools
• 6 years of experience in systems analysis, including defining technical requirements and performing high level design for complex solutions
Data Engineering
• 4 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• 2 years of experience playing a lead role in projects (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)
BI Engineering
• 3 years of experience in MicroStrategy (specific to the BI Engineering role)
• 1 year of experience in OLAP on Hadoop or any Cloud BI components (specific to the BI Engineering role)
• 2 years of playing a lead role in projects (specific to the BI Engineering role)
• Expertise in MicroStrategy/Power BI/SQL, Scripting, Teradata or equivalent RDBMS, Hadoop (OLAP on Hadoop), BI Architecting, Dashboard development, Mobile development (specific to the BI Engineering role)
Platform Engineering
• 4 years of experience in Hadoop, NO-SQL, RDBMS or any Cloud Bigdata components, Teradata, MicroStrategy (specific to the Platform Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, MicroStrategy, Oracle, MySql, SQL Server, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Platform Engineering role)Lowe&rsquo;s Technology organization believes that in-person collaboration is highly effective and helps build relationships and strengthens our culture. As such, we are leveraging an Open Office approach in how we work, meaning our tech associates will leverage time in the office to focus on highly collaborative activities as well as some remote / work from home time for autonomous endeavors. Each role has different business-driven collaboration needs that will require in-office presence.

Job ID

2007530BR

Job Category

Technology 

Employment type

Full time 

Job Classification

Open Office 

Location

Bangalore

Lead Data Engineer_Bigdata_DACI

Salesforce

Job CategoryProducts and TechnologyJob DetailsThe Infrastructure Engineering Team (Threat and Vulnerability Management) is looking for a Software Engineering MTS to help architect and build the new generation of platforms for identifying, classifying, scanning, and reporting security vulnerabilities in all Salesforce assets across the company’s cloud infrastructure.
Our security engineering team is looking for an experienced developer to design and implement infrastructure-as-a-service (IaaS) systems to orchestrate and extract vulnerability information from our assets fleet. Our services must be highly scalable and available, capable of collecting information from millions of hardware and software assets, and provide our security teams with the ability to query and act on compliance-related events. You will build state-of-the-art platforms for deploying and managing large scale scanning platforms, covering a diverse collection of assets (e.g., servers, VMs, containers, network and mobile devices) and public cloud substrates. You will design and implement systems for continuously monitoring and reporting violations of infrastructure misconfiguration across on-prem and public cloud platforms.
This is a great opportunity for ambitious engineers who want technical growth in distributed systems development, big data collection and processing, as well as security. Your talent will find significant outreach and business impact, contributing to the CISO’s security reports.Required SkillsIndustry experience 2+ years, including
Education. M.Sc/M.Engin Computer Science/Engineering or B.A/B.ScDistributed systems and data engineering. Expertise in designing, implementing and operating high-scale distributed systems architectures and concepts, including the following:High-performance, high-availability (99.999%) and self-recoverable systems
Large scale infrastructure systems
Docker-based development, especially experience using EKS
Configuration management systems, including Infrastructure-as-Code (IAC), Terraform, Puppet
Data-processing systems (e.g., Lambda architecture, Kafka, RabbitMQ, ELK)

Programming. Proficiency in object-oriented and multi-threaded programming in at least one of the following languages: Python, Golang, Java
Software design. Demonstrated expertise in applying systems patterns (e.g., Client-server, N-tier, Master/Slave, MVC) and API constructions (e.g., Swagger, OpenAPI)
Operating systems. Development and software management on Linux (e.g., CentOS, RHEL) and Windows
Security. Strong fundamentals knowledge in security concepts: authentication/authorization frameworks (e.g., SSO, SAML, Oauth), secure transport (e.g., SSL, TLS), identity management (e.g., certificates, PKI)
Communication. Excellent oral and written communication skills
Team. Ability to value team success beyond personal contributions
Desired SkillsProven track of designing and coding large-scale PaaS or IaaS systems especially for public cloud providers (e.g., AWS, Alibaba)
Experience using or operating continuous integration, continuous delivery and deployment automation (e.g., Jenkins, CloudBees, Bamboo, TeamCity)
Familiarity with source code management and version control systems (git, perforce)
Experience with code signing and build management tools (make, SCons, ant, maven, gradle).
AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request FormPosting StatementAt Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.Salesforce welcomes all.Job CategoryProducts and TechnologyJob DetailsThe Infrastructure Engineering Team (Threat and Vulnerability Management) is looking for a Software Engineering MTS to help architect and build the new generation of platforms for identifying, classifying, scanning, and reporting security vulnerabilities in all Salesforce assets across the company’s cloud infrastructure.
Our security engineering team is looking for an experienced developer to design and implement infrastructure-as-a-service (IaaS) systems to orchestrate and extract vulnerability information from our assets fleet. Our services must be highly scalable and available, capable of collecting information from millions of hardware and software assets, and provide our security teams with the ability to query and act on compliance-related events. You will build state-of-the-art platforms for deploying and managing large scale scanning platforms, covering a diverse collection of assets (e.g., servers, VMs, containers, network and mobile devices) and public cloud substrates. You will design and implement systems for continuously monitoring and reporting violations of infrastructure misconfiguration across on-prem and public cloud platforms.
This is a great opportunity for ambitious engineers who want technical growth in distributed systems development, big data collection and processing, as well as security. Your talent will find significant outreach and business impact, contributing to the CISO’s security reports.Required SkillsIndustry experience 2+ years, including
Education. M.Sc/M.Engin Computer Science/Engineering or B.A/B.ScDistributed systems and data engineering. Expertise in designing, implementing and operating high-scale distributed systems architectures and concepts, including the following:High-performance, high-availability (99.999%) and self-recoverable systems
Large scale infrastructure systems
Docker-based development, especially experience using EKS
Configuration management systems, including Infrastructure-as-Code (IAC), Terraform, Puppet
Data-processing systems (e.g., Lambda architecture, Kafka, RabbitMQ, ELK)

Programming. Proficiency in object-oriented and multi-threaded programming in at least one of the following languages: Python, Golang, Java
Software design. Demonstrated expertise in applying systems patterns (e.g., Client-server, N-tier, Master/Slave, MVC) and API constructions (e.g., Swagger, OpenAPI)
Operating systems. Development and software management on Linux (e.g., CentOS, RHEL) and Windows
Security. Strong fundamentals knowledge in security concepts: authentication/authorization frameworks (e.g., SSO, SAML, Oauth), secure transport (e.g., SSL, TLS), identity management (e.g., certificates, PKI)
Communication. Excellent oral and written communication skills
Team. Ability to value team success beyond personal contributions
Desired SkillsProven track of designing and coding large-scale PaaS or IaaS systems especially for public cloud providers (e.g., AWS, Alibaba)
Experience using or operating continuous integration, continuous delivery and deployment automation (e.g., Jenkins, CloudBees, Bamboo, TeamCity)
Familiarity with source code management and version control systems (git, perforce)
Experience with code signing and build management tools (make, SCons, ant, maven, gradle).
AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request FormPosting StatementAt Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.Salesforce welcomes all.

Backend Distributed System Engineer -MTS

Job CategoryProducts and TechnologyJob DetailsSoftware Engineer, SMTS/ LMTSJob DetailsSalesforce’s CRM Analytics (FKA Einstein Analytics) product is one of our most exciting product offerings ever. It provides an integrated analytics and AI experience within Salesforce’s CRM workflow, and is a key part of Salesforce Customer 360. We continue to attract rave reviews and are part of Gartner’s Magic Quadrant for Analytics and Business Intelligence Platforms. Our growth in terms of customers and usage has been extraordinary and this trend is expected to continue. 

The Analytics Developer tools team within CRM Analytics has an exciting opportunity for a Software Engineer. This is a terrific opportunity for someone who is excited to solve complex technical challenges around developer and engineering productivity. 

For more information on CRM Analytics, check out:
https://www.salesforce.com/products/crm-analytics/overview/
ResponsibilitiesCreate the next generation of tools, automation and infrastructure for left-shifting developer productivity tools
Move the needle on developer productivity for local dev environment, release velocity and product quality
Resolve complex technical issues and drive innovation
Relentlessly push to move from DevOps to No-Ops
Troubleshoot, determine root cause and fix issues
Define, collect and report metrics that measure progress and performance

Minimum Qualifications:BS in Computer Science or a related technical discipline, or equivalent practical experience
7+ years of industry experience, with at least 5+ in software development
Experience in software development using a general purpose programming language such as Python, Go and/or Java
Linux/Unix System Engineering and shell scripting experience

Nice to haveExperience in building/deploying services to AWS
Managing a large CI system such as Jenkins farms and/or SFCI
Enabling local kubernetes dev environment using tools such as Skaffold
Experience building Data engineering, log analysis solutions

Preferred Qualifications:Masters degree in Computer Science or a related technical field
Demonstrated expertise in build automation, CI, and DevOps
Experience architecting and developing software enabled solutions for ambiguous business problems
Hands on technical leadership in driving projects and charting technical direction
AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request FormPosting StatementAt Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.Salesforce welcomes all.Job CategoryProducts and TechnologyJob DetailsSoftware Engineer, SMTS/ LMTSJob DetailsSalesforce’s CRM Analytics (FKA Einstein Analytics) product is one of our most exciting product offerings ever. It provides an integrated analytics and AI experience within Salesforce’s CRM workflow, and is a key part of Salesforce Customer 360. We continue to attract rave reviews and are part of Gartner’s Magic Quadrant for Analytics and Business Intelligence Platforms. Our growth in terms of customers and usage has been extraordinary and this trend is expected to continue. 

The Analytics Developer tools team within CRM Analytics has an exciting opportunity for a Software Engineer. This is a terrific opportunity for someone who is excited to solve complex technical challenges around developer and engineering productivity. 

For more information on CRM Analytics, check out:
https://www.salesforce.com/products/crm-analytics/overview/
ResponsibilitiesCreate the next generation of tools, automation and infrastructure for left-shifting developer productivity tools
Move the needle on developer productivity for local dev environment, release velocity and product quality
Resolve complex technical issues and drive innovation
Relentlessly push to move from DevOps to No-Ops
Troubleshoot, determine root cause and fix issues
Define, collect and report metrics that measure progress and performance

Minimum Qualifications:BS in Computer Science or a related technical discipline, or equivalent practical experience
7+ years of industry experience, with at least 5+ in software development
Experience in software development using a general purpose programming language such as Python, Go and/or Java
Linux/Unix System Engineering and shell scripting experience

Nice to haveExperience in building/deploying services to AWS
Managing a large CI system such as Jenkins farms and/or SFCI
Enabling local kubernetes dev environment using tools such as Skaffold
Experience building Data engineering, log analysis solutions

Preferred Qualifications:Masters degree in Computer Science or a related technical field
Demonstrated expertise in build automation, CI, and DevOps
Experience architecting and developing software enabled solutions for ambiguous business problems
Hands on technical leadership in driving projects and charting technical direction
AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request FormPosting StatementAt Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.Salesforce welcomes all.

Software Engineer (SMTS/LMTS)

Apple

Key Qualifications
6+ years of experience in data engineering field with In-depth understanding of data structures and algorithms
Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data
Database development experience with Relational or MPP/distributed systems such as Oracle/Teradata/Vertica/HANA/Hadoop/ SingleStore/ SnowFlake
Programming experience in building high quality applications, data pipelines and analytics solutions. Experience in developing Big-Data applications using java, Spark, Hive, Oozie, Kafka, and Map Reduce is a huge plus
Should be proficient in writing Advanced SQLs, Expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus
Exposure to cloud methodologies and experience with AWS or GCP.
Solid experience to design and develop solutions using Columnar Databases like HANA/Vertica
Demonstrate good knowledge of development processes and agile methodologies
Strong analytical and interpersonal skills. Should be dedicated, highly motivated and should strive to learn quickly.
Description
- Design and build data structures on MPP platform like Teradata, Hadoop to provide efficient reporting and analytics capability. Design solutions using new generation In-Memory Columnar databases like HANA

- Design and build highly scalable data pipelines using Spark, Kafka to induct data from various systems 

- Translate complex business requirements into scalable technical solutions meeting data warehousing design standards. Solid understanding of analytics needs and proactive-ness to build generic solutions to improve the efficiency

- Build dashboards using Self-Service tools like Tableau and perform data analysis to support business 

- Collaborate with multiple multi-functional teams across the globe and create solutions which has larger impact on Apple business.

- You will interact with many other internal teams to lead and deliver elite products in an exciting but constantly evolving environmentEducation &amp; Experience
Bachelor’s Degree or Equivalent.Additional Requirements

Senior Data Engineer

Natwest Group

Our people work differently depending on their jobs and needs. From home working to job sharing, visit the remote and flexible working page on our website
This role is based in India and as such all normal working days must be carried out in India.Join us as a Software Engineer, AVPIn your new role, you’ll be joining our Data Engineering Transformation team responsible for delivering regulatory reporting calculations and business rule solutions
We’ll look to you to design and engineer software focusing on the customer or user experience as the primary objective
It’s a chance to hone your existing technical skills and advance your career as you develop the discipline of software engineering across the business
What you&rsquo;ll doAs a Software Engineer, you’ll design, develop and deploy applications capable of meeting and exceeding the anticipated load, performance and availability volumes, including load balancing, performance testing and benchmarking. We&rsquo;ll look to you to design the Data flow, solution architecture for reporting user cases and productise the capability for further usage. You&rsquo;ll also manage the developer feature team tasked to create technology designs and build detailed technology components in line with the approved design.You’ll be working within a feature team and using extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across the platform.You’ll also be:Producing high quality software which adds value to the business
Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
Collaborating to optimise our software engineering capability
Designing, producing, testing and implementing our working code
Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operations
The skills you&rsquo;ll needWe&rsquo;re looking for someone with a background in software engineering, software design, architecture, and an understanding of how your area of expertise supports our customers. You&rsquo;ll have strong development skills in Python spark with at least six years&rsquo; experience in orchestration and ETL components. You’ll also have experience of test-driven development alongside the use of automated test frameworks, mocking or stubbing and unit testing tools. It’ll be ideal if you have a background in solving highly complex, analytical and numerical problems. Experience in AWS will be an advantage.You’ll also need:Experience of working with code repositories, bug tracking tools and wikis as well as experience of designing and implementing APIs
Coding experience in multiple programming languages
Experience of DevOps and Agile methodology and associated toolsets and methodologies
Knowledge of relational, in-memory, distributed and NoSQL databases
Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance

Apply for this job

Jobs available in Zigup

Data engineer(15LPA-30LPA)

Data engineer(Max 25L)

Engineer II - Big Data - Hadoop/Pyspark

Lead Software Engineer - .net/C# developer

Software Engineer II

Senior Software Engineer

Lead, Data Engineer

Software Engineer - Data Engineer (3-6 Yrs) (Development)

Freecharge - Software Development Engineer - Big Data

Data Engineer

Senior Technical Trainer and Developer / Cloud Specialist

Informatica Developer

Data Engineer

Data Engineer_DACI Product

Lead Data Engineer_Bigdata_DACI Product

Lead Data Engineer_Bigdata_DACI

Backend Distributed System Engineer -MTS

Software Engineer (SMTS/LMTS)

Senior Data Engineer

Software Engineer, AVP