Principal Hadoop Administrator (Remote)
Employer
- Epsilon
Job Description
Company Description
Epsilon® is an all-encompassing global marketing innovator, supporting 15 of the top 20 global brands. We provide unrivaled data intelligence and customer insights, world-class technology including loyalty, email, and CRM platforms and data-driven creative, activation and execution. Epsilon’s digital media arm, Conversant®, is a leader in personalized digital advertising and insights through its proprietary technology and trove of consumer marketing data, delivering digital marketing with unprecedented scale, accuracy and reach through personalized media programs and through CJ Affiliate by Conversant®, one of the world’s largest affiliate marketing networks.
Together, we bring personalized marketing to consumers across offline and online channels, at moments of interest, that help drive business growth for brands. Recognized by Ad Age as the #1 World’s Largest CRM/Direct Marketing Agency Network, #1 Largest U.S. Agency from All Disciplines, #1 Largest U.S. CRM/Direct Marketing Agency Network and #1 Largest U.S. Mobile Marketing Agency, Epsilon employs over 8,000 associates in 70 offices worldwide. Epsilon is part of Alliance Data®, a “Fortune 500” and “Fortune 100 Best Places to Work For” company.
For more information, visit epsilon.com. Follow us on Twitter at @EpsilonMktg.
Job Description
Love cutting-edge tech? We do too.
At Epsilon, we do more than collect and store data and we might be the most important Internet company you’ve never heard of. Join our team for your chance to work in the digital marketing space and solve meaningful problems on a massive scale—and have fun doing it.
We are currently seeking a talented Principal Hadoop Administrator for managing critical big data deliverables with a balance of skills in design, physical implementation, and performance tuning. On our team you will help optimize and integrate new infrastructure via continuous integration methodologies, so a Big Data expert with prior DevOps experience on Linux Infrastructure is critical for this team.
About you:
- Able to do your best work in a team setting and autonomously
- Well-developed interpersonal skills.
- Owns a problem to the end
- Proud to share in team’s success
- Wants to grow a career with a great company
What you'll bring:
- Bachelor’s in Computer Science or related discipline preferred
- 10+ years of programming/scripting experience
- 4+ years of Hadoop infrastructure and Linux experience
- Knowledge of Programming Concepts in either Java, Python, or a combination of both from a previous position
- Solid Understanding of both On Premise and Cloud network architectures
- Additional Hadoop skills like Sentry, Spark, Kafka, Oozie, and similar tools of this nature
What You Will Be Doing:
- Establish milestones for necessary contributions from departments and develop processes to facilitate their collaboration
- Support cloud and On-Prem servers including security configurations, patching, and troubleshooting.
- Develop scripts for automating client/server functions
- Monitor automated systems recovery solutions
- Assist other scrum team engineers in creating practical demonstrations of proposed solutions and demonstrating them to other members of the team
- Provide detailed specifications for proposed solutions including materials, manpower and time necessary
- Provide clear goals for all areas of a project and develop steps to oversee their timely execution
- Work closely with engineering professionals within the company to maintain hardware and software needed for projects to be completed efficiently
- Mentor and train other engineers throughout the company and seek to continually improve processes companywide
- Work alongside project management teams to successfully monitor progress and implementation of initiatives
- Responsible for implementation and ongoing administration of Hadoop infrastructure
- Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
- Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, HBase and Yarn access for the new users
- Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise, etc.
- Performance tuning of Hadoop clusters and Spark routines
- Screen Hadoop cluster job performances and capacity planning
- Monitor Hadoop cluster connectivity and security
- Manage and review Hadoop log files
- File system management and monitoring
- HDFS support and maintenance
- Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
- Collaborating with application teams to perform Hadoop updates, patches, version upgrades when required
- Work with Vendor support teams on support tasks
- General operational expertise such as good troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- The most essential requirements are: They should be able to deploy Hadoop cluster, monitor critical parts of the cluster, and troubleshoot failures
- Solid Understanding on premise and Cloud network architectures
- Additional Hadoop skills like Sentry, Spark, Kafka, Oozie, etc
Preferred Skills
- Kerberos administration skills
- Experience with Cloudera or Hortonworks distribution
- Familiarity with DevOps tools like Ansible, Fabric, Shell/Python scripting
- 5 years hand-on experience on Cloud platforms – AWS or Azure
- Experience in large project implementation using: AWS EC2, ELB, S3, IAM, ECS etc.
- Experience developing engineering applications for a large corporation
- Demonstrated project development and leadership skills
- Current understanding of best practices regarding system security measures
- Experience working together with teams from several departments to facilitate the orderly execution of a proposed project plan
- Professional experience and a high-level understanding of working with various operating systems and their implications
- Knowledge of Troubleshooting Core Java Applications is a plus
- Proven track record in incorporating latest operational tools into big data platforms
- Kubernetes working knowledge
Qualifications
Additional Information
When you’re one of us, you get to run with the best. For decades, we’ve been helping marketers from the world’s top brands personalize experiences for millions of people with our cutting-edge technology, solutions and services. Epsilon’s best-in-class identity gives brands a clear, privacy-safe view of their customers, which they can use across our suite of digital media, messaging and loyalty solutions. We process 400+ billion consumer actions each day and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Positioned at the core of Publicis Groupe, Epsilon is a global company with more than 8,000 employees around the world. Check out a few of these resources to learn more about what makes Epsilon so EPIC:
- Culture:
Great People Deserve Great Benefits
We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly. If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.
Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories.
Epsilon will provide accommodations to applicants needing accommodations to complete the application process.
For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance.
Applicants with criminal histories are welcome to apply.
#LI-AM1
REF168431M
moreSimilar Jobs
Regional Care Network
CNA (Certified Nursing Assistant), West Chicago, IL - $25 an Hour
- West Chicago, IL
- 1300 days ago
Gables Search Group
Technical Inside Sales
- West Chicago, IL
- 1303 days ago
Regional Care Network
LPN (Licensed Practical Nurse), West Chicago, IL - ($45 an Hour!)
- West Chicago, IL
- 1300 days ago
CarMax
Automotive Mechanic
- West Chicago, IL
- 774 days ago
-
Location
Chicago, IL
-
Date Posted
1299 days ago
Create a Job Email Alert
We'll send you all new job offers for:

