v3.0.0 #1

Merged

zevaryx merged 55 commits from dev into main 2026-11-03 23:28:34 +00:00

Conversation 0 Commits 55 Files changed 49 +4615 -2492

zevaryx commented 2026-11-03 05:55:01 +00:00

Owner

• Copy link
• Copy Markdown

New JARVIS Core for the new v3.0.0 release

New JARVIS Core for the new v3.0.0 release

zevaryx added 29 commits 2026-11-03 05:55:01 +00:00

fix(models): add missing comma in __all__ ... 3e95bc4f6c

"Captcha" "Config" was implicitly concatenated into "CaptchaConfig", which made `from jarvis_core.db.models import *` raise AttributeError and left Captcha and Config unexported.

refactor(models)!: remove unused reddit, twitter, mastodon and backup models ... 98e9ef62ed

None of these are used by the bot or tasks anymore. mastodon.py imported a nonexistent JARVIS_INST and backups.py was never registered.

BREAKING CHANGE: Subreddit, SubredditFollow, TwitterAccount and TwitterFollow are no longer exported or registered with Beanie.

build: switch from Poetry to uv ... 18fd1073f9

Move metadata to the PEP 621 [project] table, dev tools to a PEP 735 dependency group, and build with uv_build. Replace poetry.lock with uv.lock and port the CI test and release jobs to uv. Dependency constraints are unchanged.

build(deps)!: upgrade to Beanie 2 and PyMongo's async client ... 0b65f8fdb4

Beanie 2 drops Motor, so connect() now uses pymongo.AsyncMongoClient and returns the client. Bump aiohttp, pydantic and rich to their latest releases and require Python 3.11 (PyMongo 4.19's floor).

Drop the unused orjson, PyYAML, python-dotenv and python-dateutil dependencies and the needless setuptools<70 pin. mongomock_motor cannot drive PyMongo's async client, so database tests now run against a real MongoDB named by JARVIS_TEST_MONGO_URI and are skipped without it.

BREAKING CHANGE: requires Beanie 2 / PyMongo async and Python 3.11+; Motor clients are no longer supported.

feat(db): allow choosing the database and auth source in connect() ... e92d0008ca

connect() hard-coded the jarvis/jarvis_dev database and had no way to pass authSource, so it could not reach a database-scoped user whose credentials live elsewhere (e.g. admin). Both are now optional parameters; the defaults are unchanged.

fix(db)!: store Discord IDs as int64 instead of strings ... 8d2201a118

SnowflakeDocument encoded Snowflake fields to str on save, but Beanie does not apply that encoder to query values, so every lookup by guild/user/channel ID with an int (including interactions.Snowflake) matched nothing. Drop the encoder so IDs are stored and queried as int64.

Snowflake now rejects values outside 0..2^63-1 (the int64 range every Discord ID fits in) and still accepts numeric strings so documents written by older versions keep loading until migrated.

BREAKING CHANGE: existing documents store IDs as strings and will not match queries until migrated (see the migration that follows).

fix(models): record the admin on Unban ... 62e2c5a94e

The bot and tasks both pass admin= when creating an Unban, but the model had no such field, so pydantic silently dropped it and who lifted a ban was never stored. Optional so existing documents still load.

fix(models): allow a Lock with no original overwrite ... 2039a9ccb6

When @everyone has no overwrite on a channel the bot passes original_perms=None, which raised a ValidationError after the channel had already been locked, leaving it locked with no record. Make the field optional; None means "remove the overwrite on unlock".

fix(models): add the missing guild field to Lock ... 72672e2219

The bot creates locks with guild= and /unlock, /lockdown end and the tasks unlock job all read lock.guild, but Lock never declared the field: it was discarded on save and every reader raised AttributeError. Optional so locks saved without it still load.

fix(models): make ban discriminators optional strings ... 73ce9494f2

Ban.discrim was an int with no default (so it was required) while Unban.discrim was a str; ints dropped leading zeros ("0042" became 42) and Discord's "0" (no discriminator) was stored as-is. Both now share a Discriminator type that defaults to None, maps "0" to None and restores zero padding on legacy ints. Ban.duration also gets its missing None default.

feat(models): store an explicit expiry on temporary bans ... d2db640730

Ban only had a duration in hours, so the tasks service tried to compare that integer against a datetime and never found an expired ban. Ban.expires_at is now set from created_at + duration for temp bans, giving the tasks a field they can query directly.

fix(models): normalize the legacy "perma" ban type ... ece66b742a

Older bot versions saved permanent bans with type "perma" while the model default and /bans list filter use "perm", so those bans never matched the filter. Map "perma" to "perm" on validation; the migration rewrites stored documents.

perf(models): add indexes for the bot's and tasks' query patterns ... 91dd5ae5ec

No model declared any index, so every per-message settings lookup and every tasks poll on active/expiry fields was a collection scan. Add compound indexes matching those queries (guild+setting, guild+channel, guild+user, active+expiry, ...); Beanie creates them at startup.

feat(db): add a migration for data written by jarvis-core 1.x ... 5e45195eb4

Adds jarvis_core.db.migrations (also installed as the jarvis-migrate command) to run once before deploying 2.0. It converts string-encoded Discord IDs to int64 across every model, including embedded documents and lists, rewrites the legacy "perma" ban type, normalizes discriminators, and backfills Ban.expires_at for temporary bans. Supports --dry-run and is safe to re-run.

fix(util)!: block requests to non-public addresses in hash() and get_size() ... 9486c087c8

Both helpers fetched any URL a user supplied, so the bot could be pointed at internal services (Mongo, Redis, cloud metadata) and used to probe them. Requests now go through public_session()/fetch(): only http(s), IP literals and every redirect hop are checked, and a resolver drops non-public DNS answers at connect time (covering DNS rebinding). Requests also get a 30s timeout.

hash() gains max_size, enforced while streaming instead of trusting Content-Length, and only treats data as a URL when it is a single http(s) URL; text such as "notes.txt hello" previously matched the loose URL regex and failed to hash.

BREAKING CHANGE: hash() no longer fetches scheme-less URLs (they are hashed as text), and both helpers raise UnsafeURLError (a ValueError) for blocked URLs.

fix(log): don't add a new handler on every get_logger() call ... 091dd4b7f7

Each call attached another RichHandler to the same logger, so calling it more than once for a name duplicated every log line.

fix(util): handle empty sequences in get() and bare units in unconvert_bytesize() ... df1ba89d8d

get() with no filters indexed sequence[0], which failed for empty lists and non-indexable iterables despite accepting any Iterable; it now returns the first element or None. unconvert_bytesize() rejected units such as "K" with an unhelpful list.index error; it now accepts them as "KB" and raises a clear ValueError for unknown units.

fix(filters): remove HTML entity residue from the email regex ... c59874fb56

The character classes contained "&" (from a copy-paste) instead of "&", which also admitted the stray characters a, m, p and ;.

test(filters): stop the IPv6 test from shadowing the IPv4 one ... dd6865d1d9

Both tests were named test_ipv4, so the second definition replaced the first and the IPv4 regex was never exercised.

build(pre-commit): update hooks to their latest releases ... 5cfec80458

pre-commit-hooks 6.0.0, black 26.10.1, isort 9.0.2 and flake8 7.5.0, and pre-commit 4.7.0 itself. isort moves from the archived mirrors-isort repo to PyCQA/isort.

docs: document development with uv, database tests and the 1.x migration ... e30e07a07b

Drop the nonexistent jarvis_core.config module from the README and describe the db, log and http helpers, how to run the tests against a real MongoDB, and how to migrate a 1.x database before deploying 2.0.

chore(release): 2.0.0 eaa78a41bb

test: leave server-managed system collections alone when cleaning up ... 24ff75818a

Creating a time-series collection adds system.views, which ordinary users cannot drop, so wiping the test database failed once one existed.

ci: move from GitLab CI to Forgejo Actions ... e2534e6f6c

Replace the GitLab pipeline with a Forgejo Actions workflow: pre-commit, tests on Python 3.11 and 3.12 against a Mongo service, and uv build and publish to the Forgejo package registry on tags. Needs a PACKAGE_TOKEN secret; the GitLab SAST template has no equivalent and is dropped.

ci: run workflows on ubuntu-latest ... a744b79c10

Use the ubuntu-latest runner label instead of docker.

ci: run jobs in the runner image instead of python containers ... c4e0e14336

The python job containers have no Node, which actions/checkout needs. Drop them, install uv in the ubuntu-latest image and let it fetch Python, and build Docker images on ubuntu-full-latest.

style: format with black 26 and fix the flake8 findings ... f5ed64111f

CI runs pre-commit over the whole tree. Apply black 26's formatting (blank line after module docstrings and similar) and isort, drop an unused import, and mark the migration CLI's report output as intentional print().

ci: Test against Python 3.12-3.15 767949b89f

ci: raise the open-file limit of the Mongo service container ... 25960d0a55

On a runner host whose containers default to a 1024 open-file limit, mongod aborts with WiredTiger 'Too many open files' partway through the suite and every later test fails with connection errors. Start the service with --ulimit nofile=64000:64000, the limit MongoDB recommends.

zevaryx added 2 commits 2026-11-03 06:32:58 +00:00

feat(models): add Escalation, an automatic action at a number of active warnings ... 58a0f48df6

A per-guild rule: when a member reaches exactly N active warnings, mute (with a duration, up to Discord's 28 days), kick or ban them. Validation refuses a mute without a duration, a duration on anything else, an unknown action, and a count below one. Indexed by guild and count.

chore(release): 3.0.0 ... 213ff22b8f

Move jarvis-core to 3.0.0 so it shares a version with jarvis-bot and jarvis-tasks, and say so in the README: 3.x of each work with 3.x of the others. Also includes the Escalation model added since the 2.0.0 tag.

zevaryx added 6 commits 2026-11-03 07:09:08 +00:00

feat(models): give tags a use count and aliases ... 1b52b8ac0f

Tag gains uses (how often it was fetched) and aliases (other names it answers to), both defaulting to empty so existing tags load unchanged, plus an index on guild and alias for lookups.

feat(models): let pinboards pin automatically at a reaction threshold ... b8cadf5203

Pinboard gains an optional threshold (at least 1; None keeps the board manual-only, as every existing board is) and the emoji that is counted, defaulting to a star.

feat(models): add exclusive and gated rolegiver groups and role menus ... b59020ee2d

Rolegiver groups gain exclusive (one role at a time) and required_role (a role needed before picking), both off by default. The new RoleMenu records a posted role-picker message (guild, channel, message and group) so the bot can recognise it after a restart and refresh it when the group changes.

style: format the model field tests ... e993fca704

Black formatting for the tests added with the tag, pinboard and rolegiver fields, so pre-commit passes in CI.

test: let the generic model test cover Literal and bounded fields ... 262ac346fe

test_models builds a default instance of every model, and could not build an Escalation: its action is a Literal and its warning count has a lower bound of one. Pick a Literal value that needs no companion fields and honour ge constraints, so the test covers every model again.

style: format the generic model test ... eb6b462ebc

Black formatting for the Literal and bound handling added to test_models, so pre-commit passes in CI.

zevaryx added 2 commits 2026-11-03 14:40:31 +00:00

feat(models): add WebRequest for moderation actions asked for on the website ddd8354396

docs: describe the website, its cookies and sessions in the privacy policy and terms da8bcf0442

zevaryx added 12 commits 2026-11-03 17:01:50 +00:00

feat(models): record web audit entries and name the requester of a web request admin e46d6b273d

feat(util): export everything stored about a person 41ca4230d2

docs: bring the privacy policy up to date with the bot's, adding the audit trail and data export d71d5807c1

feat(util): share the reminder rules between the bot and the website afb6e46e4d

docs: describe raid and spam alerts in the privacy policy e5b6935651

style: sort the imports of the reminder rule tests a9e3ff8d3b

feat(models): add Appeal for ban appeals made on the website bd3c17cb9d

docs: describe ban appeals in the privacy policy f3453a911d

feat(util): share the word filter and tag rules between the bot and the website 018c5720da

test: use a pattern that really backtracks in the filter timeout test 78beb67330

feat(util): share the emoji and self-service role rules with the website 06ffd2c308

feat(models): let web requests refresh a rolegiver group's posted menus 85f0acd12e

zevaryx added 4 commits 2026-11-03 17:48:08 +00:00

feat: erase a person's data from jarvis-core, add the channel and server web actions, and expire web records c85c593fa6

chore: normalise line endings to LF 7ca64d55fe

feat(util): share the limits of the alert settings with the website deab81462a

docs: describe retention and appeal notices in the privacy policy c8932ab813

zevaryx merged commit c8932ab813 into main 2026-11-03 23:28:34 +00:00

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

jarvis/jarvis-core!1

No description provided.