ci: Added github workflows for automated ci (#2)

* ci: Added github workflows for automated ci

* ci: tweaks to ci following github testing

* ci: tweak make command to install venv. Add in enforced python 3.7.17 install as seems to be installing poetry prior to python

* ci: issues with last build which may be linked to use of java 17 rather than java 8. Tweaked workflow to explicitly add java to asdf management in attempt to resolve

* ci: added asdf reshim in attempt to ensure correct versions of software are used

* ci: adding some debug as still issues with spark session instantiation

* ci: replaced asdf local with asdf set --local as different version being used on runner

* ci: replaced asdf local with asdf set as different version being used on runner

* ci: more debugging. Restructured asdf setup approach

* ci: more debugging. Restructured asdf setup approach

* ci: more debugging. export JAVA_HOME to allow correct spark session config for test step

* ci: removed debugging and reenabled skipped steps

* ci: attempt to run asdf install straight from .tool-versions

* ci: attempt to run asdf install straight from .tool-versions

* ci: use .tool-versions for asdf installs in linting and reshim prior to running of linting

* ci: added black back into linting

Author: stevenhsd

.github/workflows/ci_linting.yml

@@ -0,0 +1,52 @@
+name: CI Formatting & Linting
+
+on:
+  pull_request:
+    types: [opened, reopened, synchronize]
+    branches:
+      - main
+
+
+jobs:
+  build:
+    runs-on: ubuntu-24.04
+    steps:
+      - uses: actions/checkout@v5
+
+      - name: Install extra dependencies for a python 3.7.17 install
+        run: |
+          sudo apt-get update
+          sudo apt -y install --no-install-recommends liblzma-dev libbz2-dev libreadline-dev
+
+      - name: Install asdf cli
+        uses: asdf-vm/actions/setup@v4
+
+      - name: Install software through asdf
+        uses: asdf-vm/actions/install@v4
+      
+      - name: reshim asdf
+        run: asdf reshim
+
+      - name: Cache Poetry virtualenv
+        uses: actions/cache@v4
+        with:
+          path: ~/.cache/pypoetry
+          key: ${{ runner.os }}-poetry-${{ hashFiles('**/poetry.lock') }}
+          restore-keys: |
+            ${{ runner.os }}-poetry-
+
+      - name: Install lint dependencies
+        run: |
+          make install
+      
+      - name: Run black
+        run: poetry run black src
+
+      - name: Run isort
+        run: poetry run isort src
+
+      - name: Run mypy
+        run: poetry run mypy src
+
+      - name: Run pylint
+        run: poetry run pylint src

.github/workflows/ci_testing.yml

@@ -0,0 +1,58 @@
+name: CI Unit Tests
+
+on:
+  push:
+    branches:
+      - main
+  pull_request:
+    types: [opened, reopened, synchronize]
+
+jobs:
+  build:
+    runs-on: ubuntu-24.04
+    steps:
+      - name: Checkout code
+        uses: actions/checkout@v5
+
+      - name: Install extra dependencies for a python 3.7.17 install
+        run: |
+          sudo apt-get update
+          sudo apt -y install --no-install-recommends liblzma-dev libbz2-dev libreadline-dev
+      - name: Install asdf cli
+        uses: asdf-vm/actions/setup@v4
+
+      - name: Install software through asdf
+        uses: asdf-vm/actions/install@v4
+      
+      - name: reshim asdf
+        run: asdf reshim
+    
+      - name: Cache Poetry virtualenv
+        uses: actions/cache@v4
+        with:
+          path: ~/.cache/pypoetry
+          key: ${{ runner.os }}-poetry-${{ hashFiles('**/poetry.lock') }}
+          restore-keys: |
+            ${{ runner.os }}-poetry-
+
+      - name: Install test dependencies
+        run: |
+          make install
+
+      - name: Run pytest and coverage
+        run: |
+          export JAVA_HOME=$(asdf where java)
+          echo "JAVA_HOME - $JAVA_HOME"
+          make coverage
+      
+      - name: Upload Coverage Report
+        uses: actions/upload-artifact@v4
+        with:
+          name: coverage-xml
+          path: coverage.xml
+
+      - name: Run behave tests
+        run: |
+          export JAVA_HOME=$(asdf where java)
+          echo "JAVA_HOME - $JAVA_HOME"
+          make behave