10 Commits

Author SHA1 Message Date
13e8b5be2f fix uri
All checks were successful
Run Tox Check / tox-py312 (pull_request) Successful in 15s
Run Tox Check / tox-pep8 (pull_request) Successful in 15s
Updates Opensearch filters / update-opensearch-filters (pull_request) Successful in 10s
2025-08-13 12:02:46 +00:00
40c62b4609 fix pep8
All checks were successful
Run Tox Check / tox-py312 (pull_request) Successful in 17s
Run Tox Check / tox-pep8 (pull_request) Successful in 15s
2025-08-13 11:59:11 +00:00
e6c62e9655 collect output statistics
Some checks failed
Run Tox Check / tox-py312 (pull_request) Successful in 20s
Run Tox Check / tox-pep8 (pull_request) Failing after 15s
2025-08-13 11:54:33 +00:00
394cec25a5 chore: update analytics data [skip ci] (#43)
Co-authored-by: gitea-actions[bot] <actions@users.noreply.local>
Reviewed-on: #43
Reviewed-by: Gode, Sebastian <sebastian.gode@t-systems.com>
2025-08-11 09:24:30 +00:00
9848825516 change workflow (#41)
Reviewed-on: #41
Reviewed-by: Gode, Sebastian <sebastian.gode@t-systems.com>
Co-authored-by: tischrei <tino.schreiber@t-systems.com>
Co-committed-by: tischrei <tino.schreiber@t-systems.com>
2025-08-11 08:31:55 +00:00
17cd4cac60 debug workflow (#40)
Some checks failed
Create Weekly Analytics Stats / run-analytics (push) Failing after 7s
Co-authored-by: gitea-actions[bot] <actions@users.noreply.local>
Reviewed-on: #40
Co-authored-by: tischrei <tino.schreiber@t-systems.com>
Co-committed-by: tischrei <tino.schreiber@t-systems.com>
2025-08-08 14:01:24 +00:00
77b10c9729 collect_website_statics (#39)
Reviewed-on: #39
Co-authored-by: tischrei <tino.schreiber@t-systems.com>
Co-committed-by: tischrei <tino.schreiber@t-systems.com>
2025-08-08 13:40:25 +00:00
81fd29520d Update .gitea/workflows/create-weekly-analytics-stats.yaml (#38)
Reviewed-on: #38
Reviewed-by: Gode, Sebastian <sebastian.gode@t-systems.com>
2025-08-08 10:13:35 +00:00
f635b7351e add collect_statistics tool (#37)
Reviewed-on: #37
Reviewed-by: Gode, Sebastian <sebastian.gode@t-systems.com>
Co-authored-by: tischrei <tino.schreiber@t-systems.com>
Co-committed-by: tischrei <tino.schreiber@t-systems.com>
2025-08-08 10:09:41 +00:00
71b820ebf5 New service function (#36)
Reviewed-on: #36
Reviewed-by: Tino Schreiber <tino.schreiber@t-systems.com>
Co-authored-by: Sebastian Gode <sebastian.gode@telekom.de>
Co-committed-by: Sebastian Gode <sebastian.gode@telekom.de>
2025-08-04 09:36:23 +00:00
7 changed files with 343 additions and 0 deletions

View File

@ -0,0 +1,62 @@
name: Create Weekly Analytics Stats
on:
schedule:
# 03:00 UTC = 04:00 CET
- cron: "0 3 * * 1"
workflow_dispatch:
jobs:
run-analytics:
runs-on: ubuntu
steps:
- name: Checkout repository
uses: actions/checkout@v4
with:
token: ${{ secrets.PUSH_TOKEN }}
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: "3.12"
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install requests otc-metadata
- name: Run analytics for eu_de
env:
UMAMI_USERNAME: ${{ secrets.UMAMI_USERNAME }}
UMAMI_PASSWORD: ${{ secrets.UMAMI_PASSWORD }}
run: |
python ./tools/collect_statistics.py \
--website-id "${{ secrets.UMAMI_WEBSITE_ID }}" \
--cloud-environment "eu_de" \
--environment "public" \
--limit "10"
- name: Run analytics for swiss
env:
UMAMI_USERNAME: ${{ secrets.UMAMI_USERNAME }}
UMAMI_PASSWORD: ${{ secrets.UMAMI_PASSWORD }}
run: |
python ./tools/collect_statistics.py \
--website-id "${{ secrets.UMAMI_WEBSITE_ID }}" \
--cloud-environment "swiss" \
--environment "public" \
--limit "10"
- name: Commit and push results
run: |
git config --global user.name "gitea-actions[bot]"
git config --global user.email "actions@users.noreply.local"
git checkout -B analytics-update
git add otc_metadata/analytics/
if git diff --cached --quiet; then
echo "No changes to commit"
else
git commit -m "chore: update analytics data [skip ci]"
git push origin analytics-update --force
fi

View File

View File

@ -0,0 +1,47 @@
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
# implied.
# See the License for the specific language governing permissions and
# limitations under the License.
from pathlib import Path
import json
analytics_path = Path("otc_metadata/analytics/public")
cloud_environments = [
'eu_de',
'swiss'
]
analytics_data = {k: [] for k in cloud_environments}
# Open and read the json data files
for env in cloud_environments:
file_path = analytics_path.joinpath(f"{env}.json")
with open(file_path, 'r') as file:
analytics_data[env] = json.load(file)
class AnalyticsData(object):
"""Encapsulate OTC Analystics data"""
def __init__(self):
self._analytics_data = analytics_data
def all_analytics_data(self):
"""returns all analytics data"""
return self._analytics_data
def analytics_data_by_cloud_environment(self, cloud_environment):
"""returns all analytics data"""
if cloud_environment and cloud_environment in self._analytics_data:
return self._analytics_data[cloud_environment]
else:
raise ValueError(f"cloud_environment '{cloud_environment}' does not exist.")

View File

@ -0,0 +1,12 @@
[
"evs",
"ims",
"ecs",
"cce",
"obs",
"rds",
"sfs",
"iam",
"elb",
"apig"
]

View File

@ -0,0 +1,12 @@
[
"evs",
"ims",
"ecs",
"cce",
"obs",
"rds",
"iam",
"elb",
"cbr",
"vpc"
]

View File

@ -453,3 +453,25 @@ class Services(object):
res.sort(key=lambda x: x.get("name", "").lower()) res.sort(key=lambda x: x.get("name", "").lower())
return res return res
def all_services_by_cloud_environment(self, cloud_environment, environments):
"""Retrieve all services filtered by cloud_environment
"""
res = []
for srv in self.all_services:
if environments and cloud_environment:
for srv_cloud_environment in srv["cloud_environments"]:
if srv_cloud_environment["name"] == cloud_environment:
for environment in environments:
if srv_cloud_environment["visibility"] == environment:
res.append(srv)
else:
continue
else:
raise Exception("No cloud_environment or environments "
"specified in function all_services_by_cloud_environment.")
# Sort services
res.sort(key=lambda x: x.get("service_title", "").lower())
return res

188
tools/collect_statistics.py Executable file

File diff suppressed because it is too large Load Diff