Changes to the site this week:

Web:

• SYSADMIN: Increased heap memory of search nodes to hopefully stop random crashes.
• BUGFIX: Reply to sender on the web to a non-member of the group produced an error.
• BUGFIX: Reply to Group & Sender on the web in some cases did not send the message to the sender, only to the group.
• CHANGE: Tweak the formatting of photo album descriptions to allow for longer descriptions.
• BUGFIX: Some Facebook posts would duplicate the first image.
• CHANGE: Bolded the current page in the pagination links.
• BUGFIX: Fixed a couple of broken links in the More menu on mobile.

API:

• NEW: New subscription_plus field: nice_group_name.
• NEW: New /gettopics parameter: extended.

Have a good weekend everyone.

Mark

Changes to the site this week:

Web:

• No changes

API:

• CHANGE: The /downloadarchives endpoint has been temporarily disabled because a company was abusing it and putting too much load on the system.
• NEW: The /gettopics endpoint now works.
• NEW: Additional error codes for /login API endpoint.
• NEW: Added group_alias, org_id, org_domain fields to the 'subscription_plus' object.

A note on my focus for the next few months: https://beta.groups.io/g/main/message/18909

Have a good weekend everyone.

Mark

Changes to the site this week:

• CHANGE: Changed the Action menu in the Members page, pulling email delivery and moderation options into dialogs. This makes the Actions dropdown smaller, so it works better on mobile, and is preparation for other options being added.
• NEW: When viewing an event, show the person who created the event.
• NEW: Added event organizer information to event reminder emails.
• CHANGE: Changed how messages are sorted in digests. We now sort by date and then group by topic, which is slightly different from before. Now, the date of the first message we're showing in the topic determines the sort order of the topic, not the date of the first message ever in the topic.
• BUGFIX: We were not properly escaping newlines in the DESCRIPTION field in ICS files.
• BUGFIX: For tables with HTML Paragraph columns that were not the first column, the HTML edit widget was not properly initialized when adding/editing a row.
• CHANGE: When viewing a photo, the links to next/previous photos now extend the full height of the photo.
• BUGFIX: The Subscribe to Calendar button was improperly disabled for some subgroups.
• BUGFIX: Fix table csv imports of addresses, where the city field was being populated by the address line 2.
• CHANGE: Only display the Email link on a member's profile if the group's directory is visible to members.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Topics can have a reply to setting that overrides the group's reply to (and any associated hash tags).
• NEW: Replaced the Reply To Sender Only checkbox on hashtags with a dropdown, allowing you to override the group's reply to setting.
• NEW: When a subscriber is viewing a member's profile, display the Email button to send them an email.
• CHANGE: You can now like messages in topics that are closed (matches email behavior now)
• BUGFIX: Crash fix for database map view when geocoding cannot find a proper lat/long for an address.
• BUGFIX: Crash fix when exporting event responses.
• INTERNAL: Updated logrus logging package and fixed the logging when running a web server in development.

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: When direct adding someone to a parent group and at least one subgroup that has a direct add message, we weren't not sending out the subgroup's direct add message.
• BUGFIX: When adding a member to a subgroup, we weren't including the direct add message, if one was set.
• BUGFIX: For groups set to moderate messages with attachments, the Emailed Photos album would not show up.
• BUGFIX: For certain database table searches, only the first page would be displayed. Other pages would be blank.
• API: Return group_name with subscriptions.
• CHANGE: For pending message notification emails, add a link at the top to view the message online.
• CHANGE: If a topic has a tag that is moderated, make sure we display the moderated icon in the Topics view for that topic.
• CHANGE: Updated the list of not permitted groups on the create group page.
• NEW: First pass at a help section for the upcoming group payments system.
• CHANGE: For the event and reminder emails, for all day events that last more than one day, show both start and end days (we previously only showed the start day).
• BUGFIX: For a pending message sent from a subscriber who then unsubscribes before the pending message is viewed, do not show the View Member/Send Message buttons.
• BUGFIX: When editing a database row, when you return to view the previous page, the per page setting was ignored.
• BUGFIX: If a topic is locked and has a hashtag that is set to reply to sender only, replying on the website was not permitted.
• BUGFIX: The web server would crash when viewing a past member that had been subscribed to a subgroup that no longer exists.
• NEW: In HTML digests, there are now hashtag mute links in the message footers. I also did some editing of the text of the other links, removing some words to make space.
• NEW: In the group Hashtags page, each hashtag now has a Mute/Unmute link.
• CHANGE: Reformatted the mute/unmute hashtag pages to match modern style.
• BUGFIX: If you are the owner/moderator of a parent group viewing a poll in a subgroup that you are not subscribed to, you should not be permitted to vote in the poll, because votes are keyed to subscription records.
• BUGFIX: If multiple owners voted in a subgroup poll, the count and display would be off in the View By Answer poll view (only one owner's vote(s) would be displayed).

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: In some instances emailed images were not appearing in the Emailed Photos folder. Also reindexed the message archive.
• INTERNAL: Work on adding the ability for group owners to charge subscriptions to groups.
• CHANGE: When converting inline images into attachments, verify that a valid media type is specified before doing the conversion.
• CHANGE: Members now have 7 days instead of 3 days to auto-resubscribe after having been removed because of spam reports.
• INTERNAL: Fixed SSL certificate renew mechanism.
• NEW: New activity log messages for when a member sends a message with a new tag (in a group where new tags are restricted), a message with a tag only moderators can use, and a message without any tags (where tags are required).
• BUGFIX: For groups with attachments moderated, the add photo/add attachment buttons were not being displayed in the HTML editor.
• CHANGE: Improved file search to allow for partial name matches.
• BUGFIX: It was possible to ban a non-valid email address.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Photo search.
• CHANGE: Cleaned up and modernized all the photos pages.
• CHANGE: Ignore any autoreply headers if the message is to an email integration (normally we would drop those messages).
• BUGFIX: Fixed the email address and URL in the bounce message for messages sent to enterprise groups where you are not subscribed.
• NEW/TESTING: You can define a Display Template to specify how database tables are displayed. This is in limited testing for the moment.
• NEW: New database column type 'HTML Paragraph'.
• SYSADMIN: Replaced a badly behaving webserver.
• SYSADMIN: Updated nsqd on all machines.
• INTERNAL: More infrastructure work to make it easier to bring up new machine instances.
• CHANGE: Cap images at a max of 10k per side, regardless of group setting.

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: Fixed a bug in the /downloadarchives API endpoint.
• CHANGE: Added a bunch of panels to Account, Edit Sub and Member pages to try to make things more clear. Also worked on some of the descriptions.
• BUGFIX: The 'To' header line of Email Integrations contained an invalid email address.
• NEW: Made the database table map view display much quicker, without the flickering as it loaded the map.
• NEW: New member post status overrides: Override: moderate the first message of every topic this person starts and Override: moderate all topics started by this person
• API: New subscription post_status values: sub_poststatus_modfirstmessage, sub_poststatus_modstartedtopics
• CHANGE: Made New Poll a tab in the sidebar instead of a button on the New Topic page.
• NEW: Respect column colors in table map views.
• NEW: In a table map view, we now pop up a title when mousing over a pin.
• NEW: In a premium group, when viewing a table with an address, changed the toggle buttons between map and list views.
• NEW: Upgraded to Fontawesome 5.3.1
• BUGFIX: In a premium group, when changing the sort of a table with an address in list view, it'd go back to map view.
• MISC: Cleaned up a lot of CSS on the website and made all the icons a consistent type.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Add the group subject tag to the subject of private replies.
• NEW: When direct adding people to a parent group and subgroups, only send out one direct add notification to each member.
• CHANGE: Added text to banner that is displayed when invites or direct adds need to be approved to hopefully explain things better.
• INTERNAL: Added support for postgresql integer arrays.
• INTERNAL: Upgraded the postgresql go package.
• BUGFIX: There was a bug in the subgroup display page when categories are set up that could cause groups in the same category to not be displayed together.
• CHANGE: On the pending message page, display the 'Ban Sender' even for existing members.
• BUGFIX: For some reason, Google lost our geocode API key, which prevented the database map view from working. Had to recreate the key.
• CHANGE: When rejecting a pending subscription by email, ignore the request if the subscription is not, in fact, pending (ie it's been approved already).
• NEW: New group setting, Viruses, to set whether messages with viruses are blocked or moderated.
• API: New group field: HandleVirus
• CHANGE: Do not log a change in user or display name in the activity log of any group the user is banned from.
• CHANGE: In activity log, change "Rejected message" to "Message rejected".
• BUGFIX: Pending subscriptions older than two weeks were not being deleted.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: If NormalizeHTMLEmails is set, normalize any added member signatures as well.
• NEW: Added 'TR:' as a subject reply indicator.
• CHANGE: Made our Message-ID header line parsing code smarter, to deal with a crazy message-id of the form "salkdjjks@alksjdklas (extra unexpected stuff here)"
• CHANGE: Now removing any erroneous nulls from decoded message subject lines.
• CHANGE: When exporting Yahoo Groups, scan messages for U+FFFD characters and remove them.
• INTERNAL: Work on automated provisioning/configuration of new machines.
• SYSADMIN: Created a new, larger search cluster, and reindexed the site.
• BUGFIX: Added missing 'Reply To Group & Sender' option in full digests.
• BUGFIX: When aliasing a hashtag to another tag, existing topics were not being properly updated in the search index. So searches on the aliased-to tag would not show the aliased-from topics. This was due to two issues in how we were updating the search index.

Have a good weekend everyone.

Mark

Changes to the site this week:

• INTERNAL: Tested database backups.
• INTERNAL: Changed the internals of the database APIs to better deal with the new connection pooling system.
• CHANGE: Tweaked the wording of 'Default Post Policy' and 'Default group policy' to be more clear.
• BUGFIX: Couldn't delete a topic that had previously had a hashtag that had been deleted.
• BUGFIX: Fixed a race condition in the test topics page when deleting topics.
• CHANGE: In the Files section, display the Updated field instead of the Created field for Uploaded date.
• CHANGE: Disable Action button on Members page if no members are selected.
• CHANGE: Tweaked URL text in confirmation email to match the URL itself.

Have a good weekend everybody.

Mark

Changes to the site this week:

• BUGFIX: Fix encoding issues with CSV formatted member list download.
• CHANGE: The pending message notification email now uses the pending message's subscriber email address instead of the Sender line when describing who the message is from.
• CHANGE: On the Members page, only bring up the Action dialog if at least one member is selected.
• NEW: Include in the activity log the message sent to someone when directly adding them, similar to how invites are done.
• INTERNAL: Fixed database connection closing issue.
• INTERNAL: Moved all database connections to use a connection pooler.
• CHANGE: Help file tweaks.
• BUGFIX: Fixed two issues with chat that could cause chat messages to not be delivered to all members of the chat room.
• NEW: The member subgroups page now has a Joined column for the subgroups a member is a part of.
• SYSADMIN: Tuned the database.
• NEW: Added 'Int' and 'NS' badges to the pending messages page for messages from Integrations and Non Subscribers.
• BUGFIX: Fixed issue with approving pending messages from non-subscribers.
• BUGFIX: Fixed an issue with long running chat sessions.
• INTERNAL: Now caching some web pages.

Have a good weekend everyone.

Mark

Changes to the site this week:

• SYSADMIN: Upgraded the main database instance.
• BUGFIX: For groups without subgroups, you can now go to https://groupname.groups.io, and it will redirect correctly.
• BUGFIX: Fixed escaping of special characters in search query strings.
• BUGFIX: Fixed two bugs in the DKIM verifying library we use.
• BUGFIX: The 'Bulk Remove' button was being shown to some moderators who didn't have the right permission to use it (they were not able to actually use the feature).
• NEW: Added a section to the Help about the FBL and people being removed because of spam.
• NEW: When viewing a subgroup where you aren't subscribed, but you are a mod/owner of the parent group, the tag on the sidebar will now say 'Parent Mod' or 'Parent Owner'.
• CHANGE: Tweaked the sidebar width in certain instances, making it a little larger.
• BUGFIX: Disabled the 'Subscribe to Calendar' button for subgroups where you are not a subscriber (but are owner of the parent group).
• CHANGE: Parallelized updating the DNS servers to speed subgroup creation up.
• BUGFIX: Fixed a problem with repeating event reminders that could cause some of them to not be sent.
• BUGFIX: Fixed some labels on the group settings page for screen readers.
• CHANGE: Added wording on Display Name edit pages: "Note: When you post, your email address is also shown to group members who receive messages via email."
• NEW: On the pending message screen, if you use the Approve & Unmoderate Button to approve messages from non subscribers, a dialog will now pop up telling you that these people cannot be unmoderated (because they're not members).
• CHANGE: Upgraded Go toolchain from 9.4 to 10.3. This unexpectedly broke several parts of the web site that dealt with uploading files. Fixed.
• SYSADMIN: Upgraded main bastion host.
• CHANGE: Don't fig leaf email addresses when viewing source.
• NEW: Adding Authentication-Results header line showing DKIM/SPF tests. Only visible when viewing message source in the archives.
• SYSADMIN: Renewed *.groups.io ssl certificate.
• CHANGE: When posting a message, ignore returns clicked when editing the subject.
• BUGFIX: When viewing or editing an individual database row that has a date column, the date displayed would always be today.
• BUGFIX: When viewing or editing an individual database row that has an empty date column, the date displayed would always be today.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Replaced the 'Only Moderators Can Create Hashtags' checkbox with a dropdown, allowing messages with new hashtags to be either bounced, or the new hashtags to be removed.
• API: Changed group field: restrict_create_hash_tags is now hash_tag_permissions.
• SYSADMIN: Fixed log rotation issues on the DNS servers.
• NEW: When exporting group data, you can now export hashtag data.
• SYSADMIN: Now serving the cookie consent js/css code locally instead of from a CDN, because that was timing out.
• OTHER: Sent out the GDPR Privacy Policy update email. Dealt with a bunch of angry responses.
• INTERNAL: Deleted all user accounts not subscribed to any groups (or only subscribed to updates@) that were at least one month old.
• BUGFIX: Fix internal crash when a non-moderator of a subgroup rejects via email a pending message.
• BUGFIX: The FBL processing code was ignoring reports from some domains.
• CHANGE: Better behavior when uploading multiple files and one of them is a duplicate of an existing file. Previously we would disgard all files in the upload. Now we keep all of them up to the point of the duplicate.
• BUGFIX: If a file was renamed with either / or \ in the name, the file would be unlinked and unreachable. Fixed the bug and re-linked the affected files.
• INTERNAL: Made exportuser and exportgroup more reliable when dealing with large amounts of data.

Have a good weekend everyone.

Mark

Changes to the site this week:

• CHANGE: Only rate limit messages to members from other members, not mods/owners.
• NEW: Display Owner/Mod badges on group sidebar.
• NEW: Added domain/subdomain setup information to the help page.
• SYSADMIN: Migrated one of the DNS servers to a new machine.
• CHANGE: Updated and added sections about our data processing agreement and other aspects of GDPR.
• API: New group field: subgroup_category_id.
• NEW: Subgroup categories.
• NEW: Removed scrolling and reformatted subgroup list page.

I had not been including updates to the API in the #changelog reports. I will start doing so now.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: Bulk topic actions.
• INTERNAL: Verifying DKIM sigs of inbound emails, currently in testing only.
• BUGFIX: In some instances, when upgrading a group to premium with the annual plan, the monthly plan was selected instead.
• SYSADMIN: Fix time sync in the Groups.io machine cluster. Very embarassing.
• BUGFIX: Use the user's timezone when generating the 'On such and such' line for message replies.
• NEW: Scanning emails, files and photos for viruses/phishing. Currently in testing.
• CHANGE: For Reply To Sender groups, we don't delete any existing Reply-to headers.
• NEW: Ability for members to repost messages, with configurable parameters, for premium groups.
• CHANGE: Some domains will sometimes reply to emails with '550 This IP has sent too many messages this hour. IB504'. We now treat those as temporary errors instead of permanent errors, and retry again in an hour.
• NEW: Google map view for database tables with address columns, for premium groups.
• NEW: JSON export format for database tables, and the ability to create new tables from these exports.

Because of my vacation, the next #changelog email will be on August 3rd.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Polls have a new option to never show results to members.
• INTERNAL: Moved S3 group deletion operations into the s3server for async and more reliable operation.
• NEW: In the Edit File dialog, you can now replace the existing file with a new file.
• NEW: Premium/Enterprise groups can now create aliases for subgroups (previously they could only create aliases for main/parent groups).
• NEW: More anti-spammer work.
• NEW: Premium/Enterprise groups now have a new Banned Domains tab. Emails from non-subscribers are rejected from banned domains, as well as registrations.
• BUGFIX: Changed references to 'sub' to 'member' in the activity log to make things consistent. Changed several of the message actions to be more clear.
• BUGFIX: For subgroups that are unlisted but with open archives, the feed link wasn't included on the group home page. Also, the archive description was incorrect.
• CHANGE: When clicking the Subgroups tab while in a subgroup, don't redirect to the parent group first.
• NEW: Added DD.MM.YYYY date format preference.
• NEW: Locked Group member notice.
• CHANGE: Changed how we did code highlighting, now using the Google code prettify JS instead of directly using the CSS classes.
• INTERNAL: Upgraded TinyMCE editor to latest version.
• NEW: Group default subscription preferences for date and time display.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: User preferences for date and time display formatting.
• NEW: Lock icons are now displayed for locked groups in the Your Groups list, the My Groups page and the Subgroups page.
• NEW: Support '答复:' as an indicator in the subject of a message reply.
• NEW: 'Ban Sender' button when viewing a pending message sent from a non-member.
• INTERNAL: Changed many operations that relied on Amazon S3 to make them more reliable in the face of intermittent issues with S3 lately.
• INTERNAL: Wrote a new utility to maintain the nginx domain config files.
• NEW: Work on preventing spam signups.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: Seperate Footers group setting, places the footer in a seperate mime chunk, needed to support PGP signatures.
• BUGFIX: Special/HTML characters in event names/descriptions were not handled correctly in the generated ICS files.
• NEW: 'Allow group members to download the message archives' setting.
• CHANGE: When following a thread, insert standard message footers when we send out the initial messages.
• BUGFIX: Footers for messages sent because we're following a thread now have the unfollow link.
• BUGFIX: Wiki TOC links were broken if they contained special characters like parentheses.
• CHANGE: Slight tweaks to html footers and full digests.

Have a good weekend everybody.

Mark

Changes to the site this week:

• BUGFIX: In the mobile view, the Subgroups link was not always displayed when it should be.
• BUGFIX: Fixed several screen reader accessibility issues throughout the site.
• CHANGE: Updated the Google Group transfer page with changed directions.
• BUGFIX: Fixed the Edit button on the Hashtags page on Safari.
• BUGIFX: The 'Upload File' button was never disabled, even when it should have been, due to a typo in the HTML.
• CHANGE: Removed lavabit.com from the list of banned email domains, because they no longer have a disposable email address feature.
• CHANGE: For messages with both a plain text and html part, we now insert the message footer into both parts (previously we'd only insert it into the html part).
• CHANGE: Ignore bad certificates from Yahoo when downloading y! group photos.
• CHANGE: Tweaked plan text message footers to make them much smaller.
• CHANGE: When inviting someone who is not already a Groups.io user, prioritize setting their Full Name to what was in the invite over what their email is set to.
• CHANGE: Changed the time format in the calendar views to use am and pm instead of a and p.
• NEW: You can now change the owner of a photo album.
• NEW: You can now change the owner of an individual photo.
• BUGFIX: Removed unused Search button on the chat page.
• CHANGE: When viewing poll results, keep the order of respondents the same in View By Answer mode. Also removed pagination widget, because we don't currently paginate that page.
• BUGFIX: For messages with text larger than 32kb in length, we incorrectly passed a much shorter part of the message to the search indexer than was necessary.
• CHANGE: Changed the gavel icon to a scale to represent moderated threads.
• BUGFIX: Some error messages weren't being displayed correctly when editing a group's settings (such as group description being too short).
• NEW: Exportgroup now exports more member data, in json format. For premium/enterprise groups, we now export past member data. And we export member notices.
• NEW: You can now move photos between photo albums.
• CHANGE: In the pending message page, all buttons are disabled until at least one message is selected.
• INTERNAL: Completed switchover to new search cluster.
• CHANGE: In message, wiki and api revision list pages, if there are two revisions checked, and we check another revision, we remove the oldest revision check.

Have a good weekend everybody.

Mark