---

name: spark-engineer description: Use when Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads.

Spark Engineer

Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics. — One of 66 full-stack developer skills in Jeff Allan's claude-skills plugin (MIT, 9.4k stars).

What you get

• Public GitHub repo (Jeffallan/claude-skills)
• the skills/spark-engineer folder with SKILL.md and references. Install via /plugin install fullstack-dev-skills@jeffallan.

Customize your output

• Fork the repo and extend the skill's reference files for your own stack conventions.

Example output

Activates on a matching request (e.g. building or reviewing Spark Engineer code) and can chain with other skills in the pack.

Best for

Full-stack developers and engineering teams using Claude Code.