Releases
v0.4.0
v0.4.0 Published 2023-05-30 09:48:19
What's Changed
Bug Fixes
- Fix Mkdocs Colour Bug by @cching95 in https://github.com/rtdip/core/pull/291
Ingestion Framework
- EdgeX OPC UA Transformer by @JamesKnBr in https://github.com/rtdip/core/pull/271
- MISO Market API Data Source by @IW-SS in https://github.com/rtdip/core/pull/272
- Add Partition Pruning to non broadcast join PCDM Merge by @GBBBAS in https://github.com/rtdip/core/pull/274
- Add Filter Parameter and TagName field mapping for OPC Publisher Transformer by @GBBBAS in https://github.com/rtdip/core/pull/296
- Refactor for odbc and functions folders by @GBBBAS in https://github.com/rtdip/core/pull/299
- Pyspark 3.4.0 and delta-spark 2.4.0 support by @GBBBAS in https://github.com/rtdip/core/pull/297
- Add OPC UA Transformer Parameters by @GBBBAS in https://github.com/rtdip/core/pull/301
Other Changes
- Weather Domain and Data Model by @PaveeG in https://github.com/rtdip/core/pull/294
- Update for Micromamba Github Actions Parameters by @GBBBAS in https://github.com/rtdip/core/pull/302
- Upgrade FastAPI Package by @GBBBAS in https://github.com/rtdip/core/pull/303
New Contributors
- @IW-SS made their first contribution in https://github.com/rtdip/core/pull/272
- @PaveeG made their first contribution in https://github.com/rtdip/core/pull/294
Full Changelog: https://github.com/rtdip/core/compare/v0.3.1...v0.4.0
v0.3.1
v0.3.1 Published 2023-05-16 07:05:05
What's Changed
Bug Fixes
- Databricks System Parameter Index Change by @GBBBAS in https://github.com/rtdip/core/pull/261
- Timezone in API by @cching95 in https://github.com/rtdip/core/pull/268
Full Changelog: https://github.com/rtdip/core/compare/v0.3.0...v0.3.1
v0.3.0
v0.3.0 Published 2023-05-12 16:00:58
What's Changed
New Features
- Time Weighted Average API by @cching95 in https://github.com/rtdip/core/pull/207
- Interpolation at Time Query Function and API by @cching95 in https://github.com/rtdip/core/pull/244
Documentation
- Process Control Data Model by @GBBBAS in https://github.com/rtdip/core/pull/234
- Added Time Zone logic to Documentation by @rodalynbarce in https://github.com/rtdip/core/pull/236
Ingestion Framework
- Package Setup Update for Data Files by @GBBBAS in https://github.com/rtdip/core/pull/206
- Performance Updates, Transformer and Destinations Updates by @GBBBAS in https://github.com/rtdip/core/pull/215
- Delta Merge Destination Component by @GBBBAS in https://github.com/rtdip/core/pull/220
- Fledge transformer Component by @JamesKnBr in https://github.com/rtdip/core/pull/221
- Process Control Data Model to Delta by @GBBBAS in https://github.com/rtdip/core/pull/225
- Rest API Destination Component by @GBBBAS in https://github.com/rtdip/core/pull/223
- Hashicorp Vault Secret Component by @GBBBAS in https://github.com/rtdip/core/pull/227
- Spark ADLS Gen2 Service Principal Connect Utility by @GBBBAS in https://github.com/rtdip/core/pull/232
- Azure Key Vault Secret Component by @GBBBAS in https://github.com/rtdip/core/pull/230
- SSIP PI Transformer Components by @GBBBAS in https://github.com/rtdip/core/pull/233
- Delta Batch Updates by @GBBBAS in https://github.com/rtdip/core/pull/238
- Union of Types for ADLS Gen 2 Credentials Parameter by @GBBBAS in https://github.com/rtdip/core/pull/246
- Combine ChangeTypes for Merge of PCDM Data by @GBBBAS in https://github.com/rtdip/core/pull/242
- Support 3.3.* Pyspark Versions by @GBBBAS in https://github.com/rtdip/core/pull/251
Other Changes
- Performance Updates for Turbodbc and Databricks SQL Connector by @GBBBAS in https://github.com/rtdip/core/pull/211
- Add Arrow support for Turbodbc by @GBBBAS in https://github.com/rtdip/core/pull/212
- Turbodbc Performance Updates by @GBBBAS in https://github.com/rtdip/core/pull/213
- Delta Table Creation using Pydantic Models for Column by @GBBBAS in https://github.com/rtdip/core/pull/240
- Remove Duplicates from PCDM to Delta by @GBBBAS in https://github.com/rtdip/core/pull/241
- Updates for AMI Meter Classes by @vbayon in https://github.com/rtdip/core/pull/243
- Fix for Unioned Types on ACLs by @GBBBAS in https://github.com/rtdip/core/pull/247
Full Changelog: https://github.com/rtdip/core/compare/v0.2.2...v0.3.0
v0.2.2
v0.2.2 Published 2023-04-28 08:49:56
What's Changed
New Features
- Timezone feature for querying functions by @cching95 in https://github.com/rtdip/core/pull/199
Bug Fixes
- Github Actions Sonarcloud Refactor for forked branches by @GBBBAS in https://github.com/rtdip/core/pull/170
Documentation
- Removed repo structure from readme by @JamesKnBr in https://github.com/rtdip/core/pull/180
- Documentation Updates by @GBBBAS in https://github.com/rtdip/core/pull/202
Ingestion Framework
- Azure ADLS Gen 2 ACLs Utility by @GBBBAS in https://github.com/rtdip/core/pull/181
- S3 Bucket Policy by @GBBBAS in https://github.com/rtdip/core/pull/200
Full Changelog: https://github.com/rtdip/core/compare/v0.2.1...v0.2.2
v0.2.1
v0.2.1 Published 2023-04-21 15:26:14
What's Changed
Documentation
- Documentation Minor Updates by @JamesKnBr in https://github.com/rtdip/core/pull/136
- Fix Mkdocs error for kafka source by @cching95 in https://github.com/rtdip/core/pull/161
Ingestion Framework
- Delta Optimize and Vacuum by @GBBBAS in https://github.com/rtdip/core/pull/140
- Spark Pipeline Execute and Deploy unit tests by @JamesKnBr in https://github.com/rtdip/core/pull/142
- Add pipeline source IoT Hub and unit test by @rodalynbarce in https://github.com/rtdip/core/pull/144
- Spark Source and Destination for Kafka by @cching95 in https://github.com/rtdip/core/pull/158
- Added Kinesis source and destination by @rodalynbarce in https://github.com/rtdip/core/pull/159
- OPC UA And Process Control Data Model Transformers by @GBBBAS in https://github.com/rtdip/core/pull/162
Other Changes
- Added target to pull_request in pr workflow by @rodalynbarce in https://github.com/rtdip/core/pull/153
- AMI Meter Data Model by @vbayon in https://github.com/rtdip/core/pull/126
New Contributors
- @vbayon made their first contribution in https://github.com/rtdip/core/pull/126
Full Changelog: https://github.com/rtdip/core/compare/v0.2.0...v0.2.1
v0.2.0
v0.2.0 Published 2023-04-03 12:32:58
What's Changed
Bug Fixes
- Fix for docker build error by @GBBBAS in https://github.com/rtdip/core/pull/114
- Fix for docker build by @GBBBAS in https://github.com/rtdip/core/pull/115
- Time weighted average bug fix by @cching95 in https://github.com/rtdip/core/pull/120
Other Changes
- Documentation: Add Releases Feed to Docs Release page by @GBBBAS in https://github.com/rtdip/core/pull/69
- Documentation: Update Packages and Doc Logos by @GBBBAS in https://github.com/rtdip/core/pull/76
- Documentation: Fix Logo Alignment by @GBBBAS in https://github.com/rtdip/core/pull/78
- Pipelines: Upgrade dbx by @GBBBAS in https://github.com/rtdip/core/pull/79
- Pipelines: add spark session by @cching95 in https://github.com/rtdip/core/pull/80
- Pipelines: Add Pipelines as Extras libraries to setup by @GBBBAS in https://github.com/rtdip/core/pull/82
- Pipelines: Spark pipeline source Event hub and destination Event hub by @cching95 in https://github.com/rtdip/core/pull/83
- Pipelines: Spark pipeline Source and Destination Delta Components by @rodalynbarce in https://github.com/rtdip/core/pull/84
- Pipelines: Added Source Delta Sharing component with docs by @JamesKnBr in https://github.com/rtdip/core/pull/85
- Pipelines: Unit Tests for sources by @cching95 in https://github.com/rtdip/core/pull/88
- Pipelines: Add Transformer Eventhub body transformer by @cching95 in https://github.com/rtdip/core/pull/89
- Pipelines: Added pipeline source autoloader and unit test by @rodalynbarce in https://github.com/rtdip/core/pull/93
- Pipelines: Pipeline Executor by @GBBBAS in https://github.com/rtdip/core/pull/95
- Pipelines: Delta Table Create Utility by @GBBBAS in https://github.com/rtdip/core/pull/97
- Pipelines: Pipeline Deployment by @GBBBAS in https://github.com/rtdip/core/pull/102
- Pipelines: Pipeline Deployment Updates by @GBBBAS in https://github.com/rtdip/core/pull/103
- Pipelines: Updates for Pipeline Deployment by @GBBBAS in https://github.com/rtdip/core/pull/104
- Pipelines: Unit test for spark pipeline eventhub destination by @cching95 in https://github.com/rtdip/core/pull/105
- Pipelines: Dependency Injector on Pipeline Execute by @GBBBAS in https://github.com/rtdip/core/pull/106
- Pipelines: Unit tests for source and destination streams by @cching95 in https://github.com/rtdip/core/pull/108
- Pipelines: Pipeline Deployments and Pipeline Secrets by @GBBBAS in https://github.com/rtdip/core/pull/111
- Pipelines: Added fails tests to pipeline sources by @JamesKnBr in https://github.com/rtdip/core/pull/112
- Containers: Dockerfile refactor by @GBBBAS in https://github.com/rtdip/core/pull/116
- Pipelines: Pipeline Secrets, Converters and Deployment Updates by @GBBBAS in https://github.com/rtdip/core/pull/119
New Contributors
- @rodalynbarce made their first contribution in https://github.com/rtdip/core/pull/84
- @JamesKnBr made their first contribution in https://github.com/rtdip/core/pull/85
Full Changelog: https://github.com/rtdip/core/commits/v0.2.0
v0.2.0-beta.1
v0.2.0-beta.1 Published 2023-03-30 10:21:49 Pre-release
What's Changed
Bug Fixes
- Hotfix to remove print statement in twa function by @cching95 in https://github.com/rtdip/core/pull/99
- Fix for docker build error by @GBBBAS in https://github.com/rtdip/core/pull/114
- Fix for docker build by @GBBBAS in https://github.com/rtdip/core/pull/115
- time weighted average bug fix by @cching95 in https://github.com/rtdip/core/pull/120
Ingestion Framework
- Spark pipeline source Event hub and destination Event hub by @cching95 in https://github.com/rtdip/core/pull/83
- Spark pipeline source delta and destination delta by @rodalynbarce in https://github.com/rtdip/core/pull/84
- Added delta sharing with docs by @JamesKnBr in https://github.com/rtdip/core/pull/85
- Unit Tests for sources by @cching95 in https://github.com/rtdip/core/pull/88
- Added pipeline source autoloader and unit test by @rodalynbarce in https://github.com/rtdip/core/pull/93
- Pipeline Executor by @GBBBAS in https://github.com/rtdip/core/pull/95
- Delta Table Create Utility by @GBBBAS in https://github.com/rtdip/core/pull/97
- Upgrade dbx by @GBBBAS in https://github.com/rtdip/core/pull/79
- add spark session by @cching95 in https://github.com/rtdip/core/pull/80
- Add Pipelines as Extras libraries to setup by @GBBBAS in https://github.com/rtdip/core/pull/82
- Add pipeline eventhub body transformer by @cching95 in https://github.com/rtdip/core/pull/89
- Pipeline Deployment by @GBBBAS in https://github.com/rtdip/core/pull/102
- Pipeline Deployment Updates by @GBBBAS in https://github.com/rtdip/core/pull/103
- Updates for Pipeline Deployment by @GBBBAS in https://github.com/rtdip/core/pull/104
- Unit test for spark pipeline eventhub destination by @cching95 in https://github.com/rtdip/core/pull/105
- Dependency Injector on Pipeline Execute by @GBBBAS in https://github.com/rtdip/core/pull/106
- Unit tests for source and destination streams by @cching95 in https://github.com/rtdip/core/pull/108
- Pipeline Deployments and Pipeline Secrets by @GBBBAS in https://github.com/rtdip/core/pull/111
- Added fails tests to pipeline sources by @JamesKnBr in https://github.com/rtdip/core/pull/112
- Pipeline Secrets, Converters and Deployment Updates by @GBBBAS in https://github.com/rtdip/core/pull/119
Documentation
- Add Releases Feed to Docs Release page by @GBBBAS in https://github.com/rtdip/core/pull/69
- Update Packages and Doc Logos by @GBBBAS in https://github.com/rtdip/core/pull/76
- Fix Logo Alignment by @GBBBAS in https://github.com/rtdip/core/pull/78
Other Changes
- Dockerfile refactor by @GBBBAS in https://github.com/rtdip/core/pull/116
- Update python version for Release build by @GBBBAS in https://github.com/rtdip/core/pull/123
New Contributors
- @rodalynbarce made their first contribution in https://github.com/rtdip/core/pull/84
- @JamesKnBr made their first contribution in https://github.com/rtdip/core/pull/85
Full Changelog: https://github.com/rtdip/core/compare/v0.1.6...v0.2.0
v0.1.6
v0.1.6 Published 2023-03-21 11:41:08
What's Changed
Other Changes
- Remove print statement in TWA function by @cching95 in https://github.com/rtdip/core/pull/100
Full Changelog: https://github.com/rtdip/core/compare/v0.1.5...v0.1.6
v0.1.5
v0.1.5 Published 2023-02-24 16:55:17
What's Changed
Other Changes
- Add OS Matrix to CI Tests by @GBBBAS in https://github.com/rtdip/core/pull/65
- Real Time Data Pipelines Blog by @GBBBAS in https://github.com/rtdip/core/pull/60
- Remove OS matrix from Actions due to Boost by @GBBBAS in https://github.com/rtdip/core/pull/66
- v0.1.5 by @GBBBAS in https://github.com/rtdip/core/pull/67
Full Changelog: https://github.com/rtdip/core/compare/v0.1.4...v0.1.5
v0.1.4
v0.1.4 Published 2023-02-09 09:23:43
What's Changed
Bug Fixes
- Removal of packaging legacy version dependency by @NooraKubati in https://github.com/rtdip/core/pull/57
Other Changes
- Update tests for multiple versions of Python by @GBBBAS in https://github.com/rtdip/core/pull/40
- Roadmap 2023 by @GBBBAS in https://github.com/rtdip/core/pull/45
- v0.1.4 by @GBBBAS in https://github.com/rtdip/core/pull/46
- updated devcontainer.json by @cching95 in https://github.com/rtdip/core/pull/50
- fix spelling error in releases document by @cching95 in https://github.com/rtdip/core/pull/53
- v0.1.4 #2 by @NooraKubati in https://github.com/rtdip/core/pull/58
Full Changelog: https://github.com/rtdip/core/compare/v0.1.3...v0.1.4
v0.1.3
v0.1.3 Published 2022-12-14 11:11:41
What's Changed
Other Changes
- Add CNAME file to docs for custom domain www.rtdip.io by @GBBBAS in https://github.com/rtdip/core/pull/34
- API for Time weighted average by @cching95 in https://github.com/rtdip/core/pull/29
- Upgrade Python to 3.11 by @GBBBAS in https://github.com/rtdip/core/pull/36
- v0.1.3 by @NooraKubati in https://github.com/rtdip/core/pull/38
New Contributors
- @cching95 made their first contribution in https://github.com/rtdip/core/pull/29
- @NooraKubati made their first contribution in https://github.com/rtdip/core/pull/38
Full Changelog: https://github.com/rtdip/core/compare/v0.1.2...v0.1.3
v0.1.2
v0.1.2 Published 2022-12-08 15:07:23
What's Changed
New Features
- Updates for Mamba in CI/CD by @GBBBAS in https://github.com/rtdip/core/pull/21
Other Changes
- Add Mamba for Conda Installation by @GBBBAS in https://github.com/rtdip/core/pull/15
- Update to Micromamba Config in Github Actions by @GBBBAS in https://github.com/rtdip/core/pull/22
- Change to Micromamba Config by @GBBBAS in https://github.com/rtdip/core/pull/23
- Update scopes and remove Static App Configuration by @GBBBAS in https://github.com/rtdip/core/pull/20
- Add badges to Readme by @GBBBAS in https://github.com/rtdip/core/pull/17
- Add VSCode devcontainer by @GBBBAS in https://github.com/rtdip/core/pull/25
- Update to prerelease of docker containers by @GBBBAS in https://github.com/rtdip/core/pull/28
- Add RTDIP LF Energy logos by @GBBBAS in https://github.com/rtdip/core/pull/31
- v0.1.2 by @Amber-Rigg in https://github.com/rtdip/core/pull/32
New Contributors
- @Amber-Rigg made their first contribution in https://github.com/rtdip/core/pull/32
Full Changelog: https://github.com/rtdip/core/compare/v0.1.1...v0.1.2
v0.1.1
v0.1.1 Published 2022-11-01 18:58:45
What's Changed
Bug Fixes
- Fix to Mkdocs package by @GBBBAS in https://github.com/rtdip/core/pull/7
Other Changes
- Configure Mend Bolt for GitHub by @mend-bolt-for-github in https://github.com/rtdip/core/pull/3
- v0.1.1 by @GBBBAS in https://github.com/rtdip/core/pull/8
- Fix to Mkdocs String Package by @GBBBAS in https://github.com/rtdip/core/pull/12
- v0.1.1 by @GBBBAS in https://github.com/rtdip/core/pull/13
New Contributors
- @mend-bolt-for-github made their first contribution in https://github.com/rtdip/core/pull/3
Full Changelog: https://github.com/rtdip/core/compare/v0.1.0...v0.1.1
v0.1.0
v0.1.0 Published 2022-11-01 17:47:16
What's Changed
Other Changes
- Real Time Data Ingestion Platform by @GBBBAS in https://github.com/rtdip/core/pull/2
- v0.1.0 by @GBBBAS in https://github.com/rtdip/core/pull/4
New Contributors
- @GBBBAS made their first contribution in https://github.com/rtdip/core/pull/2
Full Changelog: https://github.com/rtdip/core/commits/v0.1.0