Skip to content

Conversation

arkq
Copy link
Contributor

@arkq arkq commented Apr 15, 2025

This PR is a subset of changes from #38196

Changes

  • Install matter-idl package in the editable mode in pigweed env
  • Keep generator storage classes in a separate file (with InMemoryStorage used in scripts)

Warning

The names and location of the matter.idl scripts were changed. Now all command line tools are installed (in the editable mode) in the pigween env during bootstrap.

As a consequence of that, when this PR is merged to master, it will be required to run . scripts/bootstrap.sh in order to install matter-idl package. Otherwise, build will fail with ModuleNotFoundError: No module named 'matter' error (somewhere in build logs).

Testing

CI will verify potential build breaks.

Manually verified that it is possible to have many packages with matter namespace installed in editable or non-editable mode and imports work correctly for all these packages.

@github-actions github-actions bot added documentation Improvements or additions to documentation scripts github workflows labels Apr 15, 2025
Copy link

github-actions bot commented Apr 15, 2025

PR #38410: Size comparison from e0cda38 to 152b0f5

Full report (75 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e0cda38 152b0f5 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1098550 1098550 0 0.0
RAM 94850 94850 0 0.0
bl702 lighting-app bl702+eth FLASH 653466 653466 0 0.0
RAM 33533 33533 0 0.0
bl702+wifi FLASH 830722 830722 0 0.0
RAM 22257 22257 0 0.0
bl706+mfd+rpc+littlefs FLASH 1063502 1063502 0 0.0
RAM 32181 32181 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 894304 894304 0 0.0
RAM 26920 26920 0 0.0
lighting-app bl702l+mfd+littlefs FLASH 976922 976922 0 0.0
RAM 24668 24668 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 818692 818692 0 0.0
RAM 120288 120288 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 827564 827564 0 0.0
RAM 125384 125384 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 774504 774504 0 0.0
RAM 113756 113756 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 758788 758788 0 0.0
RAM 113972 113972 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 542142 542142 0 0.0
RAM 205144 205144 0 0.0
lock CC3235SF_LAUNCHXL FLASH 576170 576170 0 0.0
RAM 205392 205392 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 660645 660645 0 0.0
RAM 77260 77260 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 680505 680505 0 0.0
RAM 79900 79900 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 680505 680505 0 0.0
RAM 79900 79900 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 637429 637429 0 0.0
RAM 72328 72328 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 620613 620613 0 0.0
RAM 73508 73508 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 640249 640249 0 0.0
RAM 76052 76052 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 640249 640249 0 0.0
RAM 76052 76052 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 640085 640085 0 0.0
RAM 76508 76508 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 659801 659801 0 0.0
RAM 79052 79052 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 659801 659801 0 0.0
RAM 79052 79052 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 616441 616441 0 0.0
RAM 70596 70596 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 636301 636301 0 0.0
RAM 73236 73236 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 636301 636301 0 0.0
RAM 73236 73236 0 0.0
efr32 lock-app BRD4187C FLASH 941160 941160 0 0.0
RAM 159944 159944 0 0.0
BRD4338a FLASH 735328 735328 0 0.0
RAM 234852 234852 0 0.0
window-app BRD4187C FLASH 1033696 1033688 -8 -0.0
RAM 128048 128048 0 0.0
esp32 all-clusters-app c3devkit DRAM 103408 103408 0 0.0
FLASH 1798066 1798066 0 0.0
IRAM 83846 83846 0 0.0
m5stack DRAM 121980 121980 0 0.0
FLASH 1763786 1763786 0 0.0
IRAM 117043 117043 0 0.0
linux air-purifier-app debug unknown 4848 4848 0 0.0
FLASH 2722097 2722097 0 0.0
RAM 114184 114184 0 0.0
all-clusters-app debug unknown 5656 5656 0 0.0
FLASH 6241832 6241832 0 0.0
RAM 531120 531120 0 0.0
all-clusters-minimal-app debug unknown 5528 5528 0 0.0
FLASH 5378060 5378060 0 0.0
RAM 224432 224432 0 0.0
bridge-app debug unknown 5544 5544 0 0.0
FLASH 4690844 4690844 0 0.0
RAM 202816 202816 0 0.0
camera-app debug unknown 8832 8832 0 0.0
FLASH 6756523 6756523 0 0.0
RAM 225104 225104 0 0.0
camera-controller debug unknown 9120 9120 0 0.0
FLASH 13694411 13694411 0 0.0
RAM 644336 644336 0 0.0
chip-tool debug unknown 6256 6256 0 0.0
FLASH 14078551 14078551 0 0.0
RAM 634512 634512 0 0.0
chip-tool-ipv6only arm64 unknown 39504 39504 0 0.0
FLASH 12161696 12161696 0 0.0
RAM 687144 687144 0 0.0
fabric-admin debug unknown 5936 5936 0 0.0
FLASH 12220805 12220805 0 0.0
RAM 633872 633872 0 0.0
fabric-bridge-app debug unknown 4800 4800 0 0.0
FLASH 4522736 4522736 0 0.0
RAM 190112 190112 0 0.0
fabric-sync debug unknown 5056 5056 0 0.0
FLASH 5661157 5661157 0 0.0
RAM 485480 485480 0 0.0
lighting-app debug+rpc+ui unknown 6264 6264 0 0.0
FLASH 5585857 5585857 0 0.0
RAM 207064 207064 0 0.0
lock-app debug unknown 5496 5496 0 0.0
FLASH 4758560 4758560 0 0.0
RAM 194208 194208 0 0.0
ota-provider-app debug unknown 4840 4840 0 0.0
FLASH 4380464 4380464 0 0.0
RAM 182928 182928 0 0.0
ota-requestor-app debug unknown 4792 4792 0 0.0
FLASH 4511000 4511000 0 0.0
RAM 187400 187400 0 0.0
shell debug unknown 4272 4272 0 0.0
FLASH 3013644 3013644 0 0.0
RAM 147712 147712 0 0.0
thermostat-no-ble arm64 unknown 9552 9552 0 0.0
FLASH 4200160 4200160 0 0.0
RAM 231912 231912 0 0.0
tv-app debug unknown 5832 5832 0 0.0
FLASH 5997989 5997989 0 0.0
RAM 608896 608896 0 0.0
tv-casting-app debug unknown 5416 5416 0 0.0
FLASH 12237725 12237725 0 0.0
RAM 752208 752208 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 916584 916584 0 0.0
RAM 167469 167469 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 909492 909492 0 0.0
RAM 145713 145713 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 852924 852924 0 0.0
RAM 141223 141223 0 0.0
nxp contact k32w0+release FLASH 588960 588960 0 0.0
RAM 72836 72836 0 0.0
mcxw71+release FLASH 607256 607256 0 0.0
RAM 63152 63152 0 0.0
light k32w0+release FLASH 614780 614780 0 0.0
RAM 72132 72132 0 0.0
k32w1+release FLASH 691432 691432 0 0.0
RAM 72000 72000 0 0.0
lock mcxw71+release FLASH 756472 756472 0 0.0
RAM 67564 67564 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1661804 1661804 0 0.0
RAM 212352 212352 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1565748 1565748 0 0.0
RAM 208544 208544 0 0.0
light cy8ckit_062s2_43012 FLASH 1442668 1442668 0 0.0
RAM 197312 197312 0 0.0
lock cy8ckit_062s2_43012 FLASH 1471532 1471532 0 0.0
RAM 224976 224976 0 0.0
qpg lighting-app qpg6105+debug FLASH 665724 665724 0 0.0
RAM 105188 105188 0 0.0
lock-app qpg6105+debug FLASH 623856 623856 0 0.0
RAM 99816 99816 0 0.0
stm32 light STM32WB5MM-DK FLASH 461384 461384 0 0.0
RAM 141488 141488 0 0.0
telink bridge-app tl7218x FLASH 672674 672674 0 0.0
695792 695792 0 0.0
RAM 90712 90712 0 0.0
101860 101860 0 0.0
light-app-ota-compress-lzma-factory-data tl3218x FLASH 777664 777664 0 0.0
RAM 50120 50120 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 767926 767926 0 0.0
RAM 40420 40420 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 756386 756386 0 0.0
784300 784300 0 0.0
RAM 97540 97540 0 0.0
109308 109308 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 683404 683404 0 0.0
705514 705514 0 0.0
RAM 51588 51588 0 0.0
62620 62620 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 711854 711854 0 0.0
741696 741696 0 0.0
RAM 73408 73408 0 0.0
85808 85808 0 0.0
light-switch-app-ota-shell-factory-data tl3218x_retention FLASH 709400 709400 0 0.0
RAM 37044 37044 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 603822 603822 0 0.0
603360 603360 0 0.0
RAM 138640 138640 0 0.0
148704 148704 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 791384 791388 4 0.0
818914 818918 4 0.0
RAM 96396 96396 0 0.0
107568 107568 0 0.0
tizen all-clusters-app arm unknown 5160 5160 0 0.0
FLASH 1791048 1791048 0 0.0
RAM 94472 94472 0 0.0
chip-tool-ubsan arm unknown 20180 20180 0 0.0
FLASH 20072182 20072182 0 0.0
RAM 8799832 8799832 0 0.0

@mergify mergify bot merged commit c0a7934 into project-chip:master Apr 17, 2025
77 checks passed
@arkq arkq deleted the python-idl-editable-install branch April 17, 2025 09:26
DavidKorczynski pushed a commit to google/oss-fuzz that referenced this pull request Apr 21, 2025
…rements.build.txt (#13239)

- After PR project-chip/connectedhomeip#38410
- we need to have environment variable `PW_PROJECT_ROOT` pointing to
CHIP_ROOT
dsavitsky-dsr pushed a commit to popovdg/connectedhomeip that referenced this pull request Apr 22, 2025
…ct-chip#38410)

* Fix scripts/configure

* Define PW_PROJECT_ROOT when installing requirements.build.txt

* Keep generator storage classes in separate file

* Define InMemoryStorage in matter.idl.generators.storage

* Install matter-idl in editable mode in development env

* Use "absolute" path in requirements.build.txt

* Remove IDL import hacks
srividya-p pushed a commit to srividya-p/oss-fuzz that referenced this pull request Apr 27, 2025
…rements.build.txt (google#13239)

- After PR project-chip/connectedhomeip#38410
- we need to have environment variable `PW_PROJECT_ROOT` pointing to
CHIP_ROOT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants