I am building a new eval suite at @VulcanBench that I think I'm going to call VulcanBench Frontier Systems v1. My idea is to build an eval suite around difficult, multi-hour engineering work in underrepresented systems, with mechanically verifiable outcomes. Looking for experts with experience in any of the areas below to help design and validate tasks: - Verilog/FPGA - Erlang - Ada/SPARK - COBOL/Fortran - Compilers Not looking for tricks, puzzles, etc. I really want tasks that represent real work, i.e. things like debugging, implementation, optimization, migration, or recovery in systems an expert actually cares about. If this is your domain, or you know someone who you think would be a good fit, I’d love an introduction. Oh and this is not a paid gig, I'm spending thousands of dollars a month running benchmarks and building my own eval suites. I have zero funding atm. Unlike Gartner, you can't pay to look good in my benchmarks 😜 You would get credit of course for your contribution, and know that you're helping to contribute to frontier model benchmarking. DMs open.