flaky_tests: Skip requeuing known flaky tests

[eliu-figma]

This PR enables skipping requeues for known flaky tests.

When the queue is created, it reads the known flaky tests filepath from the ENV. This file stores a list of known flaky tests. These known flakes are stored in the queue configuration

Whenever there is a failure, we check whether the test is in the known flakes list and skip requeuing if it is.

test

I added unit tests. I also modified the github action to make sure that the test ran properly.

I don't know why the python tests are failing - I didn't touch the python library at all, and it looks like they were already failing on master

I tested the updated ci-queue implementation by pinning the commit SHA in a figma/figma branch and saw things ran as expected: https://github.com/figma/figma/pull/571339

• Saw no requeues for flaky tests in the build

deploy

After merging to master, take the commit SHA and pin it in the sinatra Gemfile in figma/figma

[eliu-figma]

This was blocking the unit tests from running

[eliu-figma]

The github action tests on this PR were failing because only the modern MiniTest version was present in the environment.

It looks like the most recent commit reverted a change that renamed all MiniTest to Minitest so I didn't want to modify it in the library. Instead, I added a compatibility patch to support Minitest when running these tests in the github action

[eliu-figma]

https://mattbrictson.com/blog/minitest-and-rails#minitest-or-minitest

[eliu-figma]

this suppresses warnings in the test environment because this test was giving a warning which did not match the expected output

  test_utf8_tests_and_marshal                                     FAIL (0.71s)
        Expected "/opt/hostedtoolcache/Ruby/3.3.0/x64/lib/ruby/gems/3.3.0/gems/activesupport-5.2.8.1/lib/active_support/notifications/fanout.rb:3: warning: mutex_m was loaded from the standard library, but will no longer be part of the default gems since Ruby 3.4.0. Add mutex_m to your Gemfile or gemspec. Also contact author of activesupport-5.2.8.1 to add mutex_m into its gemspec.\n/opt/hostedtoolcache/Ruby/3.3.0/x64/lib/ruby/gems/3.3.0/gems/activesupport-5.2.8.1/lib/active_support/xml_mini.rb:4: warning: base64 was loaded from the standard library, but will no longer be part of the default gems since Ruby 3.4.0. Add base64 to your Gemfile or gemspec. Also contact author of activesupport-5.2.8.1 to add base64 into its gemspec.\n/opt/hostedtoolcache/Ruby/3.3.0/x64/lib/ruby/gems/3.3.0/gems/activesupport-5.2.8.1/lib/active_support/xml_mini.rb:5: warning: bigdecimal was loaded from the standard library, but will no longer be part of the default gems since Ruby 3.4.0. Add bigdecimal to your Gemfile or gemspec. Also contact author of activesupport-5.2.8.1 to add bigdecimal into its gemspec.\n" to be empty.
        /home/runner/work/ci-queue/ci-queue/ruby/test/integration/minitest_redis_test.rb:730:in `test_utf8_tests_and_marshal'