Mateusz Mandera 9406bfbc0a analytics: Store realm disk space used as a CountStat. ...

Fixes #29632.

The issue description explains this well:

We currently recalculate `currently_used_upload_space_bytes` every file
upload, by dint of calling `flush_used_upload_space_cache`  on
save/delete, and then immediately calling
`user_profile.realm.currently_used_upload_space_bytes()` in
`notify_attachment_update`.  Since this walks the Attachments table,
recalculating this can take seconds in large realms.

Switch this to using a CountStat, so we don't need to walk significant
chunks of the Attachment table when we upload an attachment.  This will
also give us a historical daily graph of usage.

2024-05-09 10:54:44 -07:00

..

fixtures

data_import: Remove gitter data import tool.

2024-05-02 13:25:25 -07:00

images

…

__init__.py

…

test_alert_words.py

…

test_attachments.py

…

test_audit_log.py

groups: Allow setting anonymous group to settings while editing.

2024-05-08 18:20:14 -07:00

test_auth_backends.py

realm: Add an alias realm_url and deprecate realm_uri in the API.

2024-05-08 17:39:15 -07:00

test_bots.py

streams: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_cache.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_compatibility.py

python: Reformat with Ruff formatter.

2024-02-29 17:07:16 -08:00

test_create_video_call.py

video_calls: Add default password to zoom meetings.

2024-04-12 08:49:08 -07:00

test_custom_profile_data.py

custom_profile_fields: Make required field optional during update.

2024-04-15 16:52:11 -07:00

test_data_types.py

…

test_decorators.py

python: Mark regexes as raw strings.

2024-04-26 12:30:31 -07:00

test_delete_unclaimed_attachments.py

python: Mark regexes as raw strings.

2024-04-26 12:30:31 -07:00

test_digest.py

email-digest: Update translated strings for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_docs.py

help-relative-links: Update relative help links for channel rename.

2024-05-03 13:05:57 -07:00

test_drafts.py

i18n: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_email_change.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_email_log.py

invites: Lock the realm when determining invitation counts.

2024-05-02 14:23:04 -07:00

test_email_mirror.py

streams: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_email_notifications.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_embedded_bot_system.py

models: Extract zerver.models.bots.

2023-12-16 22:08:44 -08:00

test_event_queue.py

tornado: Stop collapsing "restart" events via virtual events.

2024-02-15 15:42:50 -08:00

test_event_system.py

groups: Update group objects to pass anonymous groups data for settings.

2024-05-08 18:20:14 -07:00

test_events.py

groups: Allow setting anonymous group to settings while editing.

2024-05-08 18:20:14 -07:00

test_example.py

invites: Lock the realm when determining invitation counts.

2024-05-02 14:23:04 -07:00

test_external.py

ruff: Fix RUF027 Possible f-string without an f prefix.

2024-03-01 09:30:04 -08:00

test_github.py

…

test_has_request_variables.py

…

test_health.py

…

test_home.py

groups: Update group objects to pass anonymous groups data for settings.

2024-05-08 18:20:14 -07:00

test_hotspots.py

stream_settings_ui: Go to newly created stream.

2024-04-17 15:35:19 -07:00

test_i18n.py

invites: Lock the realm when determining invitation counts.

2024-05-02 14:23:04 -07:00

test_import_export.py

zulip_update: Send group DM for realm imported from other product.

2024-05-08 17:05:59 -07:00

test_integrations_dev_panel.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_integrations.py

…

test_internet.py

…

test_invite.py

invites: Lock the realm when determining invitation counts.

2024-05-02 14:23:04 -07:00

test_legacy_subject.py

…

test_link_embed.py

worker: Split into separate files.

2024-04-16 23:00:02 -07:00

test_management_commands.py

models: Extract zerver.models.streams.

2023-12-16 22:08:44 -08:00

test_markdown.py

streams-settings-overlay: Update hash for stream to channel rename.

2024-04-30 14:44:12 -07:00

test_mattermost_importer.py

zulip_update: Send group DM for realm imported from other product.

2024-05-08 17:05:59 -07:00

test_message_delete.py

message_delete: Update "first_message_id" on message deletion.

2024-04-30 14:15:22 -07:00

test_message_dict.py

message: Merge unnecessary cache_transformer step.

2024-02-14 12:27:03 -08:00

test_message_edit_notifications.py

actions: Rename *topic local variables to *topic_name.

2024-01-15 09:40:43 -08:00

test_message_edit.py

tests: Use NamedUserGroup for queries.

2024-04-26 17:03:09 -07:00

test_message_fetch.py

narrow: Do not create huddles when fetching messages.

2024-04-16 09:57:55 -07:00

test_message_flags.py

streams: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_message_move_stream.py

i18n: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_message_move_topic.py

messages: Only check the UserMessage row if necessary.

2024-03-22 09:30:17 -07:00

test_message_notification_emails.py

soft_reactivate: Soft reactivate if group mention has < 12 members.

2024-04-24 17:40:37 -07:00

test_message_send.py

tests: Use NamedUserGroup for queries.

2024-04-26 17:03:09 -07:00

test_message_topics.py

streams: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_messages.py

models: Extract zerver.models.recipients.

2023-12-16 22:08:44 -08:00

test_middleware.py

models: Replace realm.uri with realm.url.

2024-05-08 11:12:43 -07:00

test_migrations.py

CVE-2024-27286: Delete dangling UserMessage rows.

2024-03-19 18:22:24 -04:00

test_mirror_users.py

models: Extract zerver.models.clients.

2023-12-16 22:08:44 -08:00

test_muted_users.py

…

test_new_users.py

create_user: Send a group DM to admins for low licenses warning.

2024-04-03 12:28:05 -07:00

test_notification_data.py

models: Extract zerver.models.scheduled_jobs.

2023-12-16 22:08:44 -08:00

test_onboarding.py

…

test_openapi.py

api_documentation: Document "/invites/{prereg_id}" endpoint.

2024-04-20 18:12:04 -07:00

test_outgoing_http.py

…

test_outgoing_webhook_interfaces.py

message: Split MessageDict and friends into its own file.

2024-02-14 12:27:03 -08:00

test_outgoing_webhook_system.py

message-send: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_populate_db.py

…

test_presence.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_push_notifications.py

realm: Add an alias realm_url and deprecate realm_uri in the API.

2024-05-08 17:39:15 -07:00

test_queue_worker.py

invites: Remove invites worker, make confirmation object in-process.

2024-05-02 14:23:04 -07:00

test_queue.py

…

test_rate_limiter.py

…

test_reactions.py

message: Split MessageDict and friends into its own file.

2024-02-14 12:27:03 -08:00

test_read_receipts.py

…

test_realm_domains.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_realm_emoji.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_realm_export.py

models: Replace realm.uri with realm.url.

2024-05-08 11:12:43 -07:00

test_realm_linkifiers.py

requirements: Upgrade Python requirements.

2024-01-29 10:41:54 -08:00

test_realm_playgrounds.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_realm.py

realm: Add an alias realm_url and deprecate realm_uri in the API.

2024-05-08 17:39:15 -07:00

test_recipient_parsing.py

i18n: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_redis_utils.py

…

test_report.py

…

test_retention.py

retention: Add .restored_timestamp to ArchiveTransaction.

2024-05-09 10:54:44 -07:00

test_rocketchat_importer.py

zulip_update: Send group DM for realm imported from other product.

2024-05-08 17:05:59 -07:00

test_scheduled_messages.py

python: Mark regexes as raw strings.

2024-04-26 12:30:31 -07:00

test_scim.py

scim: Add config option to disable initial streams for guests.

2024-04-11 12:28:26 -07:00

test_send_email.py

…

test_server_settings.py

…

test_service_bot_system.py

python: Reformat with Ruff formatter.

2024-02-29 17:07:16 -08:00

test_sessions.py

ruff: Fix PLW0108 Lambda may be unnecessary.

2024-03-01 09:30:04 -08:00

test_settings.py

settings: Add new web information density settings.

2024-03-27 12:58:32 -07:00

test_signup.py

models: Replace realm.uri with realm.url.

2024-05-08 11:12:43 -07:00

test_slack_importer.py

zulip_update: Send group DM for realm imported from other product.

2024-05-08 17:05:59 -07:00

test_slack_message_conversion.py

…

test_soft_deactivation.py

mentions: Update backend tests to not use only "stream" wildcard.

2024-04-04 11:16:07 -07:00

test_subdomains.py

models: Replace realm.uri with realm.url.

2024-05-08 11:12:43 -07:00

test_submessage.py

message: Merge unnecessary cache_transformer step.

2024-02-14 12:27:03 -08:00

test_subs.py

help: Rename and redirect stream-sending-policy for channel.

2024-05-03 13:02:20 -07:00

test_templates.py

…

test_thumbnail.py

…

test_timeout.py

timeout: Rename to unsafe_timeout.

2024-04-18 11:50:38 -07:00

test_timestamp.py

…

test_timezone.py

ruff: Fix UP036 Version block is outdated for minimum Python version.

2024-04-01 18:32:52 -07:00

test_tornado.py

…

test_transfer.py

requirements: Upgrade Python requirements.

2024-01-29 10:41:54 -08:00

test_tutorial.py

help: Move 'channels-and-topics' to 'introduction-to-topics'.

2024-05-07 16:51:48 -07:00

test_typed_endpoint.py

python: Add missing TypeAlias annotations.

2024-04-01 16:19:56 -07:00

test_typing.py

i18n: Update translated errors for stream to channel rename.

2024-04-24 14:35:05 -07:00

test_upload_local.py

python: Mark regexes as raw strings.

2024-04-26 12:30:31 -07:00

test_upload_s3.py

python: Mark regexes as raw strings.

2024-04-26 12:30:31 -07:00

test_upload.py

analytics: Store realm disk space used as a CountStat.

2024-05-09 10:54:44 -07:00

test_urls.py

compose_validate: Remove autosubscribe feature.

2024-03-28 09:06:48 -07:00

test_user_groups.py

groups: Allow setting anonymous group to settings while editing.

2024-05-08 18:20:14 -07:00

test_user_status.py

models: Extract zerver.models.clients.

2023-12-16 22:08:44 -08:00

test_user_topics.py

exceptions: Add IncompatibleParametersError as a JsonableError.

2024-04-29 16:58:47 -07:00

test_users.py

analytics: Improve do_increment_logging_stat performance.

2024-05-06 16:34:01 -07:00

test_validators.py

ruff: Fix E226 Missing whitespace around arithmetic operator.

2024-03-01 09:30:04 -08:00

test_webhooks_common.py

webhooks: Rename stream_name to channel_name arg.

2024-05-04 19:01:51 -07:00

test_widgets.py

todo_widget: Allow tasks to be added through /todo command.

2024-04-13 21:56:33 -07:00

test_zcommand.py

…

test_zephyr.py

models: Extract zerver.models.realms.

2023-12-16 22:08:44 -08:00

test_zulip_update_announcements.py

zulip_update: Send group DM for realm imported from other product.

2024-05-08 17:05:59 -07:00