Senior Data Engineer

Full Time

Atlassian is continuing to hire with all interviewing and on-boarding done virtually due to COVID-19. All new and existing Atlassians will continue to work from home until it’s safe to return to our offices. When our offices re-open, every Atlassian will have the choice to work from an office or from home.

JOB DUTIES:

WORK WITH SOFTWARE DEVELOPMENT TO BUILD WORLD‑CLASS DATA SOLUTIONS AND APPLICATIONS THAT POWER CRUCIAL BUSINESS DECISIONS THROUGHOUT THE COMPANY. ARCHITECT, BUILD, LAUNCH, AND MANAGE DATA MODELS TO ENABLE ANALYTICS. DESIGN, BUILD, AND MANAGE DATA WAREHOUSE. DESIGN, BUILD, IMPROVE, AND MANAGE DATA PIPELINES AND ETL JOBS. CREATE ETL SCRIPTS VIA SQL/HIVEQL/SPARKSQL/PYSPARK ON DATABRICKS PLATFORM USING AMAZON WEB SERVICES (AWS). AUTOMATE DATA PIPELINE AND REPORTING PROCESSES. BUILD DATA EXPERTISE AND OWN DATA QUALITY FOR DATA PIPELINES. ENGINEER SOFTWARE SYSTEMS AT SCALE AND COORDINATE THE PROCESS TO MAKE THAT DATA USEFUL FOR ANALYTICS. BUILD COMPUTER-BASED DATA MODELS AND EXTRACTION-TRANSFORMATION-LOADING (ETL) PROCESSES TO PROVIDE PERTINENT DATA FOR COMPANY’S BUSINESS USE. IMPROVE UPON COMPANY’S CURRENT REPORTING SOFTWARE PLATFORMS AND DATA VISUALIZATION. SERVE AS THE DATA DOMAIN EXPERT. IMPART PERTINENT SOFTWARE INFORMATION REGARDING THE BUSINESS DATA AND ANALYTICS TO COMPANY’S TECHNOLOGY TEAMS, ANALYTICAL TEAMS, AND DATA SCIENTISTS ACROSS VARIOUS INITIATIVES. OWN THE COMPUTER-BASED PROBLEMS END‑TO‑END, COLLECT, EXTRACT, AND ENSURE THAT THE DATA IS PREPARED FOR A SPECIFIC BUSINESS SECTOR’S USE. AUTOMATE THE ANALYSES AND REPORTING TOOLS FOR THE SOFTWARE SYSTEMS THAT GENERATED THE DATA. IMPROVE DATA INTEGRITY AND USABILITY BY ADDING NEW SOURCES, CODING BUSINESS RULES, AND PRODUCING NEW METRICS THAT SUPPORT THE BUSINESS.  WORK ON SOLUTION BUILDING AND ARCHITECTING TO BUILD COMPANY’S PUBLIC CLOUD OFFERINGS INCLUDING AMAZON WEB SERVICES, REDSHIFT, S3, EMR/SPARK, AND PRESTO/ATHENA. WORK WITH SOFTWARE TOOLS INCLUDING FLASK WEB FRAMEWORK IN ORDER TO CONSTRUCT AND INTEGRATE RESTFUL APPLICATION PROGRAMMING INTERFACES (APIS) AND MICROSERVICES. WORK ON SOLUTION BUILDING AND ARCHITECTING WITH PUBLIC CLOUD OFFERINGS SUCH AS AWS, REDSHIFT, S3, EMR/SPARK, PRESTO/ATHENA. WORK WITH SPARK AND HIVE. UTILIZE SQL, SQL TUNING, SCHEMA DESIGN, PYTHON AND ETL PROCESSES. WORK ON DATA PIPELINE WITH SUCH WORKFLOW TOOLS AS AIRFLOW, OOZIE OR LUIGI. UTILIZE UNDERSTANDING OF BUILDING RESTFUL APIS AND MICROSERVICES, E.G. WITH FLASK. WORK WITH TABLEAU, MACHINE LEARNING. APPLY EXPERTISE WITH TEST AUTOMATION AND ENSURING DATA QUALITY ACROSS MULTIPLE DATASETS USED FOR ANALYTICAL PURPOSES. WORK WITH LAMBDA ARCHITECTURE AND OTHER BIG DATA ARCHITECTURAL BEST PRACTICES. WORK ON TEST AUTOMATION AND CONTINUOUS DELIVERY. 

MINIMUM REQUIREMENTS:

MASTER’S DEGREE IN COMPUTER SCIENCE OR RELATED FIELD PLUS 2 YEARS OF EXPERIENCE AT MARKETING ORGANIZATION OR USING ADVERTISING TECHNOLOGIES, WORKING ON AUTOMATION AND CONTINUOUS DELIVERY, SOLUTION BUILDING AND ARCHITECTING WITH PUBLIC CLOUD OFFERINGS, SUCH AS AMAZON WEB SERVICES, REDSHIFT, S3, EMR/SPARK, PRESTO/ATHENA, BUILDING RESTFUL APIS AND MICROSERVICES, E.G. WITH FLASK, AND USING LAMBDA ARCHITECTURE OR OTHER BIG DATA ARCHITECTURAL BEST PRACTICES.

ALTERNATE REQUIREMENTS:

BACHELOR’S DEGREE IN COMPUTER SCIENCE OR RELATED FIELD PLUS 5 YEARS OF EXPERIENCE AT MARKETING ORGANIZATION OR USING ADVERTISING TECHNOLOGIES, WORKING ON AUTOMATION AND CONTINUOUS DELIVERY, SOLUTION BUILDING AND ARCHITECTING WITH PUBLIC CLOUD OFFERINGS, SUCH AS AMAZON WEB SERVICES, REDSHIFT, S3, EMR/SPARK, PRESTO/ATHENA, BUILDING RESTFUL APIS AND MICROSERVICES, E.G. WITH FLASK, AND USING LAMBDA ARCHITECTURE OR OTHER BIG DATA ARCHITECTURAL BEST PRACTICES.

SPECIAL REQUIREMENTS:

MUST PASS TECHNICAL INTERVIEW
More about our benefits

Whether you work in an office or a distributed team, Atlassian is highly collaborative and yes, fun! To support you at work (and play) we offer some fantastic perks: ample time off to relax and recharge, flexible working options, five paid volunteer days a year for your favourite cause, an annual allowance to support your learning & growth, unique ShipIt days, a company paid trip after five years and lots more.

More about Atlassian

Creating software that empowers everyone from small startups to the who’s who of tech is why we’re here. We build tools like Jira, Confluence, Bitbucket, and Trello to help teams across the world become more nimble, creative, and aligned—collaboration is the heart of every product we dream of at Atlassian. From Amsterdam and Austin, to Sydney and San Francisco, we’re looking for people who want to write the future and who believe that we can accomplish so much more together than apart. At Atlassian, we’re committed to an environment where everyone has the autonomy and freedom to thrive, as well as the support of like-minded colleagues who are motivated by a common goal to: Unleash the potential of every team.

Additional Information

We believe that the unique contributions of all Atlassians is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.

All your information will be kept confidential according to EEO guidelines.

Learn more about Atlassian’s culture, interviewing flow, and hiring process by checking out our Candidate Resource Hub.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Apply Now
Share this job: