Description

vere-v3.5 is a minor runtime release with the following highlighted changes:

• Fixes a false positive from double boot protection when there are multiple messages in flight.
• Fixes the -X argument that allows you to scry into a pier without starting it.
• Fixes a possibility for a race condition between vere io drivers and double boot protection.
• Better error messages when using outdated moon keys, remove dead urbit.org links and print when doing epoch rollover.

What's Changed

• vere: fix some undefined behavior by @joemfb in #820
• u3: remove unnecessary refcount operations (losing u3_none) by @joemfb in #828
• nock: lose subject in autocons more eagerly by @Quodss in #827
• u3: skip null slots in u3h_take() and friends by @joemfb in #825
• u3: refactor unifying equality by @joemfb in #819
• Revert "nock: lose subject in autocons more eagerly" by @pkova in #830
• Better error message for bad moon keys by @mopfel-winrux in #833
• pier: fix double boot protection by @yosoyubik in #839
• lmdb: fix undefined behavior (load of misaligned address) by @matthew-levan in #843
• pier: fix -X scry by @yosoyubik in #835
• mug: murmur3 revendor with size_t to support 64-bit by @matthew-levan in #842
• Fix broken urbit.org links by @bonbud-macryg in #834
• pier: initialize drivers after double boot protection by @pkova in #847
• build: remove old bazel artifacts by @matthew-levan in #852
• build: update zlib dependency for zig 0.14 by @pkova in #858

New Contributors

• @bonbud-macryg made their first contribution in #834

Full Changelog: vere-v3.4...vere-v3.5

Description

This minor runtime release fixes three issues:

• If the vere process got killed during initial boot from keyfile the ship would perform extremely poorly until it got melded
• A long-standing issue where some ships were unable to use the meld subcommand.
• A misconfigured openssl build on aarch64 caused a segfault when using the HTTP client to connect to a site using tls 1.3. This was most trivially reproduced in the dojo by doing +https://facebook.com. Note that this bug did not affect x86_64.

What's Changed

• mars: really don't install the ivory pill in the serf by @pkova in #813
• build: work around zig linker bug in macos-aarch64 openssl assembly by @pkova in #815
• zig v0.14.0 redux by @matthew-levan in #792
• zig: new hash format by @Quodss in #817
• vere: adds melt, rewrites meld for efficiency by @joemfb in #632
• Release vere-v3.4 by @pkova in #822

Full Changelog: vere-v3.3...vere-v3.4

Description

vere-v3.3 is a bugfix release for a regression introduced in vere-v3.2. The new directed messaging driver was assigned an incorrect driver priority which means that ames packets will always be handled before terminal keystrokes or HTTP requests, exactly the opposite of the intended behavior. This would mean that ships getting spammed with ames packets would appear significantly less responsive than before.

This bugfix release restores the ames packet priority to be low and fixes a HTTP caching bug found by ~migrev-dolseg.

What's Changed

• http: only check cache on GET requests by @will-hanlen in #806
• auto: fix driver priority by @pkova in #807
• Release vere-v3.3 by @pkova in #808

New Contributors

• @will-hanlen made their first contribution in #806

Full Changelog: vere-v3.2...vere-v3.3

Description

vere-v3.2 brings the following highlighted features:

• Compatibility with the upcoming zuse 410 kelvin release.
• A directed messaging driver for 1-3 orders of magnitude faster networking performance.
• Lagoon jets for native matrix math in Urbit.
• Double boot protection to prevent the most common cause of irrecoverable ship failure.
• Loom memory usage statistics in Arvo to help hosting providers and provide a foundation for zero click maintenance.
• HTTP scry streaming for serving individual chunks of large files over HTTP.

Note that all these features are dependent on the 410k Arvo release.

Moon keyfiles generated with Arvo versions of 411 or above are not compatible with vere-v3.2. To recreate an old moon keyfile, upgrade Arvo to 410 first and then do |moon-cycle-keys <moon-name>. This only applies to the moon keyfiles, previously booted moons can upgrade to vere-v3.2 without issue.

What's Changed

• Merge develop to next/kelvin/410 by @pkova in #652
• Add crc32 jet by @nathanlever in #653
• Merge develop to next/kelvin/410 by @pkova in #666
• Double boot protection by @ripperi in #657
• Merge develop to next/kelvin/410 by @pkova in #673
• mass: improvements by @matthew-levan in #677
• Mesa route switching by @belisarius222 in #667
• Merge develop to next/kelvin/410 by @pkova in #687
• double-boot protection: bug fix & more informative error messages by @ripperi in #689
• Merge release back to develop by @pkova in #702
• Merge master back to develop after vere-v3.1 by @pkova in #706
• Merge develop to next/kelvin/410 by @pkova in #707
• lick: add : to prints to match other vanes by @matthew-levan in #704
• mass: return memory report to arvo by @tinnus-napbus in #675
• Merge develop to next/kelvin/410 by @pkova in #713
• mesa: misc. bugfixes by @yosoyubik in #716
• http: streaming by @midden-fabler in #676
• mesa: more misc bugfixes by @yosoyubik in #718
• Lagoon jets for IEEE 754 floats. by @sigilante in #638
• Add debugging instructions by @sigilante in #685
• Add stacktrace by @ripperi in #674
• Aor jet by @Quodss in #690
• Merge develop to next/kelvin/410 by @pkova in #721
• Lick Pointer bug by @mopfel-winrux in #722
• events: do not read garbage memory on empty control files by @pkova in #724
• misc: fix tons of undefined behavior vol 2 by @pkova in #723
• zig build system by @ripperi in #719
• ci: fix typo in docker-shared.yml by @ripperi in #725
• ci: split dockerfile copy command by @ripperi in #726
• ci: fix gcloud upload by @ripperi in #727
• ci: change working directory of docker build steps by @ripperi in #728
• ci: change context of docker build steps by @ripperi in #729
• ci: fix latest deployed version string by @ripperi in #730
• Fix generated GMP assembly sources on x86_64 linux by @ripperi in #733
• docs: add configure opts to gmp readme by @ripperi in #734
• build: upgrade gmp to 6.3.0 by @pkova in #735
• Merge develop to next/kelvin/410 by @pkova in #737
• Merge 3.2 to edge by @pkova in #738
• vere: kelvin 410 by @joemfb in #630
• ChaCha jets by @lukechampine in #637
• jets: for new atom ops by @joemfb in #627
• jets: adds $plot (+fax and +mes) by @joemfb in #631
• build: refactor and decouple pkg builds from main build by @ripperi in #742
• build: install vere as a quick fix for missing version.h in CI by @ripperi in #743
• Add support for linux gnu build targets by @ripperi in #741
• term: fix use after free by @pkova in #744
• build: add build opts for enabling sanitizers by @ripperi in #731
• vere: adds %quic loom measurement, support it and |mass in conn by @joemfb in #740
• main: really ignore SIGPIPE by @pkova in #745
• Misc mesa improvements by @pkova in #746
• misc: update ivory pill by @pkova in #749
• serf: do not install ivory pill for now by @pkova in #750
• manage: do not u3l_log when generating the stacktrace by @pkova in #753
• mesa: don't free pict before hamt get by @yosoyubik in #751
• king: do not retry on http 3xx in king_curl_bytes by @pkova in #752
• add jets for luck:ed, sign-raw:ed, sign-raw-octs:ed, scad:ed, scas:ed, scap:ed by @newxiphiness in #748
• ames, mesa: miscellaneous stuff by @pkova in #754
• ames, mesa: revert static receive buffer allocation by @pkova in #755
• mesa: track outstanding request fragments for congestion control by @pkova in #756
• vere: don't double free egg by @yosoyubik in #757
• ames: do not leak stun request packets by @pkova in #758
• mesa: improvements by @pkova in #760
• dawn: fix comet mining by @yosoyubik in #761
• Merge vere-v3.2 to soon for release candidate by @pkova in #762
• mesa: fixes by @pkova in #763
• misc: more fixes by @pkova in #764
• Urwasm jet by @Quodss in #747
• mesa: fix pit clear timer cleanup by @pkova in #765
• ++sew jet by @Quodss in #698
• Merge develop to release for rc by @pkova in #767
• Merge develop to release by @pkova in #770
• mesa: use %arvo lanes on %ames %push by @yosoyubik in #772
• mesa: move forwarding page before checking request by @yosoyubik in #774
• build: update for zig v0.14.0 by @matthew-levan in #766
• Revert "build: update for zig v0.14.0" by @pkova in #776
• play: add --watch-replay flag by @matthew-levan in #775
• ames: scry for lanes using /chums/[ship]/lanes by @yosoyubik in #777
• Revert "ames: scry for lanes using /chums/[ship]/lanes" by @pkova in #778
• Merge develop to release by @pkova in #779
• mesa: ignore lanes sending page packets by @yosoyubik in #780
• mesa: do not insert new request if old still pending by @pkova in #781
• Merge develop to release by @pkova in #782
• Merge release back to develop by @pkova in #783
• http: fix segfault if request times out during scry by @pkova in #786
• Merge develop to release by @pkova in #787
• verstable: always run value destructors after key destructors by @pkova in #789
• Merge develop to release by @pkova in #790
• mesa: add test for encoding failure by @yosoyubik in #788
• Merge develop to release by @pkova in #791
• build: rename "pact-test", enable in ci by @joemfb in #793
• misc: fixes for vere-v3.2 by @pkova in #795
• Merge develop to release by @pkova in #796
• pier: fix double boot protection for breaches by @yosoyubik in #797
• Merge develop to release by @pkova in #798
• Merge release back to develop by @pkova in #799
• mesa: more fixes by @pkova in #802
• Merge develop to release by @pkova in #803
• Merge release back to develop by @pkova in #804
• Release vere-v3.2 by @pkova in #805

New Contributors

• @nathanlever made their first contribution in https://githu...

Description

vere-v3.1 is a a minor runtime release with the following highlighted features:

• Rebinding eyre HTTP cache entires.
• The runtime now automatically tries to open the Ames port on a home network using the NAT-PMP protocol. This will improve connectivity on self-hosted setups.
• Restore the ctrl+z functionality to instantly force kill the urbit process.
• Plug memory leaks related to DNS queries. This has resulted in significant uptime improvements for select Urbit Foundation infrastructure ships.
• More reliable lockfile and replay error handling.
• Miscellaneous error message improvements.

What's Changed

• jets: make a real jet for swp by @pkova in #577
• build: recent macOS updates clang by @mrdomino in #579
• Revert "build: recent macOS updates clang" by @pkova in #588
• build: bump openssl dep by @mrdomino in #586
• BLAKE3 jets by @lukechampine in #535
• Revert "Revert "build: recent macOS updates clang"" by @pkova in #598
• vere: adds --gc-early flag to pack and meld subcommands by @joemfb in #613
• http: dynamic responses for empty cache entries by @Fang- in #603
• vere: add flag to continue running after behn: queue blocked by @joemfb in #618
• vere: disable systemd and apparmor for the dbus dependency by @pkova in #582
• nix: update flake.lock to fix FHSUserEnv by @eamsden in #565
• vere: bring your own boot sequence by @Fang- in #544
• stun: corrects response decoding, adds tests by @joemfb in #623
• macos: fix lldb by @pkova in #611
• events: better error messages for partial write by @pkova in #622
• ames: add libnatpmp for automatic port forwarding by @pkova in #593
• add more helpful chop message by @jalehman in #635
• disk: fix broken chop error message by @pkova in #642
• Revert "ames: add libnatpmp for automatic port forwarding" by @pkova in #644
• Revert "disk: fix broken chop error message" by @pkova in #643
• main: restore SIGTSTP handler after replay by @pkova in #656
• disk: parameterize lmdb map size by @matthew-levan in #655
• ames: free packet on successful galaxy dns resolution by @pkova in #658
• fix nock 9 crashing pier if axis is cell by @Quodss in #661
• ames: libnatpmp for real this time by @pkova in #646
• boot: replay in subprocess by @matthew-levan in #654
• ames: resolve galaxy dns in batches; plug leak by @joemfb in #639
• vere: support .run in subprocess replay by @joemfb in #663
• vere: respect --loom in subprocess replay by @joemfb in #664
• ames: only print packet drop-count on drop by @joemfb in #665
• ames: factor out stun implementation and basic de/serialization functions by @joemfb in #662
• docs: lsp integration by @matthew-levan in #670
• nix: fix vere compilation by @h33p in #633
• Update notice about swap space URL. by @sigilante in #625
• u3: better recovery from crashes during snapshot patch application by @joemfb in #651
• gitignore MODULE.bazel and lock by @belisarius222 in #680
• bazel: change mirror for libnatpmp because it's always down by @pkova in #681
• bazel: change openssl mirror to github since openssl.org is down by @pkova in #683
• disk: update epoc.txt and vere.txt atomically by @pkova in #669
• play: use libuv for replay by @matthew-levan in #682
• Update VERSION to 3.1 by @pkova in #686
• events: even better error messages for partial write by @jalehman in #636
• stun: fix stun by @pkova in #694
• docs: add autoconf-archive to installation instructions by @matthew-levan in #692
• vere: use fcntl advisory locks on pidfile by @joemfb in #697
• Release vere-v3.1 by @pkova in #705

New Contributors

• @mrdomino made their first contribution in #579
• @Quodss made their first contribution in #661

Full Changelog: vere-v3.0...vere-v3.1

Description

During pre-release testing of vere-v3.1-rc3 we discovered that replaying in a subprocess introduced a failure case in Native Planet lockfile handling heuristics.

Vere lockfile handling is meant to prevent multiple vere processes from starting the same pier at the same time. Unfortunately this lockfile handling has historically been poor and sometimes the lockfile sticks around after a vere process exits abnormally. Native Planet was using PID heuristics to delete these lingering lockfiles, but this method was broken after #654.

This release candidate contains #697 that uses advisory locking syscalls to significantly improve lockfile reliability. The fix has also been tested to work across the Docker host -> container barrier.

What's Changed

• docs: add autoconf-archive to installation instructions by @matthew-levan in #692
• vere: use fcntl advisory locks on pidfile by @joemfb in #697

Full Changelog: vere-v3.1-rc3...vere-v3.1-rc4

Description

During pre-release testing of vere-v3.1-rc2 it was discovered that informal pinging was broken. This remained undetected because informal pinging falls back to formal pinging when malfunctioning. This release candidate includes #694 to fix the issue.

What's Changed

• stun: fix stun by @pkova in #694

Full Changelog: vere-v3.1-rc2...vere-v3.1-rc3

Description

During pre-release testing of vere-v3.1-rc1 we discovered that a PR for improving error messages when the disk is full was mistakenly not included. This release candidate includes #636 with the improved error messages.

Full Changelog: vere-v3.1-rc1...vere-v3.1-rc2

What's Changed

• events: even better error messages for partial write by @jalehman in #636

Full Changelog: vere-v3.1-rc1...vere-v3.1-rc2

Description

vere-v3.1 is a a minor runtime release with the following highlighted features:

• Rebinding eyre HTTP cache entires.
• The runtime now automatically tries to open the Ames port on a home network using the NAT-PMP protocol. This will improve connectivity on self-hosted setups.
• Restore the ctrl+z functionality to instantly force kill the urbit process.
• Plug memory leaks related to DNS queries. This has resulted in significant uptime improvements for select Urbit Foundation infrastructure ships.

What's Changed

• jets: make a real jet for swp by @pkova in #577
• build: recent macOS updates clang by @mrdomino in #579
• Revert "build: recent macOS updates clang" by @pkova in #588
• build: bump openssl dep by @mrdomino in #586
• BLAKE3 jets by @lukechampine in #535
• Revert "Revert "build: recent macOS updates clang"" by @pkova in #598
• vere: adds --gc-early flag to pack and meld subcommands by @joemfb in #613
• http: dynamic responses for empty cache entries by @Fang- in #603
• vere: add flag to continue running after behn: queue blocked by @joemfb in #618
• vere: disable systemd and apparmor for the dbus dependency by @pkova in #582
• nix: update flake.lock to fix FHSUserEnv by @eamsden in #565
• vere: bring your own boot sequence by @Fang- in #544
• Merge master back to develop after vere-v3.0 by @pkova in #621
• stun: corrects response decoding, adds tests by @joemfb in #623
• macos: fix lldb by @pkova in #611
• events: better error messages for partial write by @pkova in #622
• ames: add libnatpmp for automatic port forwarding by @pkova in #593
• add more helpful chop message by @jalehman in #635
• disk: fix broken chop error message by @pkova in #642
• Revert "ames: add libnatpmp for automatic port forwarding" by @pkova in #644
• Revert "disk: fix broken chop error message" by @pkova in #643
• main: restore SIGTSTP handler after replay by @pkova in #656
• disk: parameterize lmdb map size by @matthew-levan in #655
• ames: free packet on successful galaxy dns resolution by @pkova in #658
• fix nock 9 crashing pier if axis is cell by @Quodss in #661
• ames: libnatpmp for real this time by @pkova in #646
• boot: replay in subprocess by @matthew-levan in #654
• ames: resolve galaxy dns in batches; plug leak by @joemfb in #639
• vere: support .run in subprocess replay by @joemfb in #663
• vere: respect --loom in subprocess replay by @joemfb in #664
• ames: only print packet drop-count on drop by @joemfb in #665
• ames: factor out stun implementation and basic de/serialization functions by @joemfb in #662
• docs: lsp integration by @matthew-levan in #670
• nix: fix vere compilation by @h33p in #633
• Update notice about swap space URL. by @sigilante in #625
• u3: better recovery from crashes during snapshot patch application by @joemfb in #651
• gitignore MODULE.bazel and lock by @belisarius222 in #680
• bazel: change mirror for libnatpmp because it's always down by @pkova in #681
• bazel: change openssl mirror to github since openssl.org is down by @pkova in #683
• disk: update epoc.txt and vere.txt atomically by @pkova in #669
• play: use libuv for replay by @matthew-levan in #682
• Update VERSION to 3.1 by @pkova in #686
• Merge develop to release by @pkova in #688

New Contributors

• @mrdomino made their first contribution in #579
• @Quodss made their first contribution in #661

Full Changelog: vere-v3.0...vere-v3.1

Description

The big ticket items for this vere release include the epoch system, support for persistent nock caching, informal pings and MDNS local routing. The epoch system is functional immediately after upgrading to vere-v3.0, the other features are reliant on the 411k release slated for ~2024.3.18.

This release is not backwards compatible with vere-v2.12 and earlier. A ship cannot be downgraded after upgrading to vere-v3.0.

Epoch System

The epoch system cuts the previously uniform event log into "epochs" associated with a specific runtime version. The epochs are represented as directories in the file system. Here is an example of epochs under the Foundation galaxy ~deg that has been running the vere-v3.0 pre-release for a while:

ls ./deg/.urb/log/
0i0  0i95419173  0i98550959  0i99182407  0i99543593  data.mdb  lock.mdb

Each epoch folder is identified by an event number and includes a snapshot and a part of the event log. If the snapshot of a ship gets corrupted the ship may have to replay; the epoch system makes this process more pleasant since the ship no longer has to replay the entire event log. A replay can be initiated from the latest valid epoch, significantly speeding up the process.

The latest snapshot for a ship is situated in the latest epoch, 0i99543593 in the above case. All other epochs are safe to relocate elsewhere or even delete.

The default behavior for the epoch system is to create a new epoch every time the vere runtime version changes. A user may also manually create a new epoch by using the urbit roll command.

The urbit chop command now deletes all epochs except for the last two.

What's Changed

• jets: match hoon changes to bif:by by @ashelkovnykov in #439
• Merge develop to next/kelvin/411 by @pkova in #505
• pier: decrement arvo kelvin by @pkova in #506
• Merge master back to develop after vere-v2.12 by @pkova in #517
• Update VERSION to 3.0 by @pkova in #518
• Epoch System by @matthew-levan in #459
• u3: rewrites jam atom encoding to maximize its range by @joemfb in #363
• Fixed next/kelvin workflow to not upload to docker by @mopfel-winrux in #529
• vere: support stack traces on failing boot / full replay by @joemfb in #523
• Fix advisory types in dor/mor jets. by @sigilante in #534
• hoon: 138k by @joemfb in #526
• epoc: cleanup by @joemfb in #531
• u3: inline cell deconstruction by @joemfb in #536
• u3: declares %139 jets for +scot and +scow by @joemfb in #537
• ames: resolve galaxy ips using ipv4 only by @pkova in #543
• vere: refactors event log metadata reading to avoid the loom by @joemfb in #547
• disk: check for null pointer when writing through fak_o by @pkova in #548
• serf: adds new, stateful memory-pressure thresholds by @joemfb in #546
• UIP-0103: Persistent Nock Caching + Loom Migration Framework + Pointer Compression Migration Refactor by @matthew-levan in #508
• u3: adjust free-list sizes by @joemfb in #539
• serf: reclaim from persistent memoization cache by @joemfb in #549
• ames: handle %nail gift, lanes to vere cache by @pkova in #541
• u3: adds unconditional freelist migration as workaround by @joemfb in #551
• jets: refactors and optimizes tree-math jets by @joemfb in #397
• Fix typo in ames.c by @sigilante in #550
• u3: redeclare inline u3x_atom for linkability by @joemfb in #552
• jet +mate arm by @sidnym-ladrut in #512
• fixes +fitz jet mismatch by @mikolajpp in #444
• build: fetch urcrypt instead of vendoring it by @matthew-levan in #524
• u3: removes free-list ream from v3 migration by @joemfb in #553
• build: install autoconf-archive in docker workflow by @matthew-levan in #554
• build: fix docker workflow by @matthew-levan in #555
• u3: restore old-style, efficient reap to u3m_love() by @joemfb in #538
• u3: optimizes u3i_edit (nock opcode 10) by @joemfb in #362
• merge develop into next/kelvin/411 by @joemfb in #560
• ames: account for variable-size num fragments by @yosoyubik in #561
• lick: Shut bug by @mopfel-winrux in #563
• mdns: add mdns for local network routing by @pkova in #511
• stun: minimal working client/server by @yosoyubik in #545
• ames: clean up libuv timers by @pkova in #568
• jets: declare %138 separately by @joemfb in #567
• ames, http: declare gang correctly when scrying by @pkova in #569
• bazel: change dbus source since the official site is down by @pkova in #572
• bazel: looks like this makes the docker CI work by @pkova in #573
• Merge develop to next/kelvin/411 by @pkova in #571
• ames: independent galaxy dns resolution for stun by @yosoyubik in #574
• ames: fix galaxy domain check by @yosoyubik in #575
• Merge next/kelvin/411 to develop by @pkova in #576
• Merge develop to release for vere-v3.0-rc1 by @pkova in #578
• vere: add --serf-bin option to provide path to serf by @eamsden in #566
• Revert "vere: add --serf-bin option to provide path to serf" by @matthew-levan in #583
• mdns: distinguish fake ships in the mdns namespace by @pkova in #584
• bazel: bump zlib by @pkova in #590
• fix epoch migration bug by @matthew-levan in #592
• ames: fix ames czar prints by @yosoyubik in #595
• epoc: fix log metadata write bug, make pre-release repair more robust by @joemfb in #596
• vere: fix chop by @joemfb in #599
• vere: fix epoc lifecycle error handling, enforce invariants by @joemfb in #602
• http: do not double free scry cache path by @pkova in #606
• v3-migrate: ream before reclaiming bytecode caches by @pkova in #608
• Revert "u3: restore old-style, efficient reap to u3m_love()" by @pkova in #612
• vere: adds --gc-early flag to pack and meld subcommands by @pkova in #615
• Release vere-v3.0 by @pkova in #619

New Contributors

• @sidnym-ladrut made their first contribution in #512
• @mikolajpp made their first contribution in #444
• @yosoyubik made their first contribution in #561

Full Changelog: vere-v2.12...vere-v3.0