Changes to the site this week:

• SYSADMIN: Upgraded the main database instance.
• BUGFIX: For groups without subgroups, you can now go to https://groupname.groups.io, and it will redirect correctly.
• BUGFIX: Fixed escaping of special characters in search query strings.
• BUGFIX: Fixed two bugs in the DKIM verifying library we use.
• BUGFIX: The 'Bulk Remove' button was being shown to some moderators who didn't have the right permission to use it (they were not able to actually use the feature).
• NEW: Added a section to the Help about the FBL and people being removed because of spam.
• NEW: When viewing a subgroup where you aren't subscribed, but you are a mod/owner of the parent group, the tag on the sidebar will now say 'Parent Mod' or 'Parent Owner'.
• CHANGE: Tweaked the sidebar width in certain instances, making it a little larger.
• BUGFIX: Disabled the 'Subscribe to Calendar' button for subgroups where you are not a subscriber (but are owner of the parent group).
• CHANGE: Parallelized updating the DNS servers to speed subgroup creation up.
• BUGFIX: Fixed a problem with repeating event reminders that could cause some of them to not be sent.
• BUGFIX: Fixed some labels on the group settings page for screen readers.
• CHANGE: Added wording on Display Name edit pages: "Note: When you post, your email address is also shown to group members who receive messages via email."
• NEW: On the pending message screen, if you use the Approve & Unmoderate Button to approve messages from non subscribers, a dialog will now pop up telling you that these people cannot be unmoderated (because they're not members).
• CHANGE: Upgraded Go toolchain from 9.4 to 10.3. This unexpectedly broke several parts of the web site that dealt with uploading files. Fixed.
• SYSADMIN: Upgraded main bastion host.
• CHANGE: Don't fig leaf email addresses when viewing source.
• NEW: Adding Authentication-Results header line showing DKIM/SPF tests. Only visible when viewing message source in the archives.
• SYSADMIN: Renewed *.groups.io ssl certificate.
• CHANGE: When posting a message, ignore returns clicked when editing the subject.
• BUGFIX: When viewing or editing an individual database row that has a date column, the date displayed would always be today.
• BUGFIX: When viewing or editing an individual database row that has an empty date column, the date displayed would always be today.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Replaced the 'Only Moderators Can Create Hashtags' checkbox with a dropdown, allowing messages with new hashtags to be either bounced, or the new hashtags to be removed.
• API: Changed group field: restrict_create_hash_tags is now hash_tag_permissions.
• SYSADMIN: Fixed log rotation issues on the DNS servers.
• NEW: When exporting group data, you can now export hashtag data.
• SYSADMIN: Now serving the cookie consent js/css code locally instead of from a CDN, because that was timing out.
• OTHER: Sent out the GDPR Privacy Policy update email. Dealt with a bunch of angry responses.
• INTERNAL: Deleted all user accounts not subscribed to any groups (or only subscribed to updates@) that were at least one month old.
• BUGFIX: Fix internal crash when a non-moderator of a subgroup rejects via email a pending message.
• BUGFIX: The FBL processing code was ignoring reports from some domains.
• CHANGE: Better behavior when uploading multiple files and one of them is a duplicate of an existing file. Previously we would disgard all files in the upload. Now we keep all of them up to the point of the duplicate.
• BUGFIX: If a file was renamed with either / or \ in the name, the file would be unlinked and unreachable. Fixed the bug and re-linked the affected files.
• INTERNAL: Made exportuser and exportgroup more reliable when dealing with large amounts of data.

Have a good weekend everyone.

Mark

Changes to the site this week:

• CHANGE: Only rate limit messages to members from other members, not mods/owners.
• NEW: Display Owner/Mod badges on group sidebar.
• NEW: Added domain/subdomain setup information to the help page.
• SYSADMIN: Migrated one of the DNS servers to a new machine.
• CHANGE: Updated and added sections about our data processing agreement and other aspects of GDPR.
• API: New group field: subgroup_category_id.
• NEW: Subgroup categories.
• NEW: Removed scrolling and reformatted subgroup list page.

I had not been including updates to the API in the #changelog reports. I will start doing so now.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: Bulk topic actions.
• INTERNAL: Verifying DKIM sigs of inbound emails, currently in testing only.
• BUGFIX: In some instances, when upgrading a group to premium with the annual plan, the monthly plan was selected instead.
• SYSADMIN: Fix time sync in the Groups.io machine cluster. Very embarassing.
• BUGFIX: Use the user's timezone when generating the 'On such and such' line for message replies.
• NEW: Scanning emails, files and photos for viruses/phishing. Currently in testing.
• CHANGE: For Reply To Sender groups, we don't delete any existing Reply-to headers.
• NEW: Ability for members to repost messages, with configurable parameters, for premium groups.
• CHANGE: Some domains will sometimes reply to emails with '550 This IP has sent too many messages this hour. IB504'. We now treat those as temporary errors instead of permanent errors, and retry again in an hour.
• NEW: Google map view for database tables with address columns, for premium groups.
• NEW: JSON export format for database tables, and the ability to create new tables from these exports.

Because of my vacation, the next #changelog email will be on August 3rd.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Polls have a new option to never show results to members.
• INTERNAL: Moved S3 group deletion operations into the s3server for async and more reliable operation.
• NEW: In the Edit File dialog, you can now replace the existing file with a new file.
• NEW: Premium/Enterprise groups can now create aliases for subgroups (previously they could only create aliases for main/parent groups).
• NEW: More anti-spammer work.
• NEW: Premium/Enterprise groups now have a new Banned Domains tab. Emails from non-subscribers are rejected from banned domains, as well as registrations.
• BUGFIX: Changed references to 'sub' to 'member' in the activity log to make things consistent. Changed several of the message actions to be more clear.
• BUGFIX: For subgroups that are unlisted but with open archives, the feed link wasn't included on the group home page. Also, the archive description was incorrect.
• CHANGE: When clicking the Subgroups tab while in a subgroup, don't redirect to the parent group first.
• NEW: Added DD.MM.YYYY date format preference.
• NEW: Locked Group member notice.
• CHANGE: Changed how we did code highlighting, now using the Google code prettify JS instead of directly using the CSS classes.
• INTERNAL: Upgraded TinyMCE editor to latest version.
• NEW: Group default subscription preferences for date and time display.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: User preferences for date and time display formatting.
• NEW: Lock icons are now displayed for locked groups in the Your Groups list, the My Groups page and the Subgroups page.
• NEW: Support '答复:' as an indicator in the subject of a message reply.
• NEW: 'Ban Sender' button when viewing a pending message sent from a non-member.
• INTERNAL: Changed many operations that relied on Amazon S3 to make them more reliable in the face of intermittent issues with S3 lately.
• INTERNAL: Wrote a new utility to maintain the nginx domain config files.
• NEW: Work on preventing spam signups.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: Seperate Footers group setting, places the footer in a seperate mime chunk, needed to support PGP signatures.
• BUGFIX: Special/HTML characters in event names/descriptions were not handled correctly in the generated ICS files.
• NEW: 'Allow group members to download the message archives' setting.
• CHANGE: When following a thread, insert standard message footers when we send out the initial messages.
• BUGFIX: Footers for messages sent because we're following a thread now have the unfollow link.
• BUGFIX: Wiki TOC links were broken if they contained special characters like parentheses.
• CHANGE: Slight tweaks to html footers and full digests.

Have a good weekend everybody.

Mark

Changes to the site this week:

• BUGFIX: In the mobile view, the Subgroups link was not always displayed when it should be.
• BUGFIX: Fixed several screen reader accessibility issues throughout the site.
• CHANGE: Updated the Google Group transfer page with changed directions.
• BUGFIX: Fixed the Edit button on the Hashtags page on Safari.
• BUGIFX: The 'Upload File' button was never disabled, even when it should have been, due to a typo in the HTML.
• CHANGE: Removed lavabit.com from the list of banned email domains, because they no longer have a disposable email address feature.
• CHANGE: For messages with both a plain text and html part, we now insert the message footer into both parts (previously we'd only insert it into the html part).
• CHANGE: Ignore bad certificates from Yahoo when downloading y! group photos.
• CHANGE: Tweaked plan text message footers to make them much smaller.
• CHANGE: When inviting someone who is not already a Groups.io user, prioritize setting their Full Name to what was in the invite over what their email is set to.
• CHANGE: Changed the time format in the calendar views to use am and pm instead of a and p.
• NEW: You can now change the owner of a photo album.
• NEW: You can now change the owner of an individual photo.
• BUGFIX: Removed unused Search button on the chat page.
• CHANGE: When viewing poll results, keep the order of respondents the same in View By Answer mode. Also removed pagination widget, because we don't currently paginate that page.
• BUGFIX: For messages with text larger than 32kb in length, we incorrectly passed a much shorter part of the message to the search indexer than was necessary.
• CHANGE: Changed the gavel icon to a scale to represent moderated threads.
• BUGFIX: Some error messages weren't being displayed correctly when editing a group's settings (such as group description being too short).
• NEW: Exportgroup now exports more member data, in json format. For premium/enterprise groups, we now export past member data. And we export member notices.
• NEW: You can now move photos between photo albums.
• CHANGE: In the pending message page, all buttons are disabled until at least one message is selected.
• INTERNAL: Completed switchover to new search cluster.
• CHANGE: In message, wiki and api revision list pages, if there are two revisions checked, and we check another revision, we remove the oldest revision check.

Have a good weekend everybody.

Mark

Changes to the site this week:

• INTERNAL: Lots of optimization work on speeding up the creation of a new message search index.
• SYSADMIN: Built a new search cluster with additional needed capacity.
• BUGFIX: When exporting an event with RSVPs that allow additional guests, show the additional guest numbers.
• BUGFIX: Fixed a database connection error with the Elasticsearch importer that was waking me up at 3am the last couple of nights. Zzzzzz.
• CHANGE: Subscription Options and Muting & Following updates in the help (thanks Shal and J!).
• NEW: Treat 'Cvp:' as the same as Re: in message subjects (it's Turkish).
• CHANGE: Condensed HTML message footers.
• CHANGE: For groups not set to reply to group, display the receiver's email address in the footer.
• CHANGE: Do not permit group names that begin or end in dash.
• BUGFIX: The display of groups in the 'Your Groups' dropdown could sometimes be wrong on the home page, based on how you were sorting that page.
• BUGFIX: Use the subgroup direct add message for direct adds. Previously we were erroneously using the parent group direct add message and ignoring any subgroup direct add messages.
• CHANGE: For transfers of groups with more than 100,000 messages, we ask for a year's premium subscription. Otherwise, we'll transfer the 100,000 most recent messages.
• BUGFIX: In the transfer interface, improved handling of how we scrape Yahoo Groups in different languages.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: The website now requires consent for cookies.
• NEW: Added cookie policy.
• NEW: Revamped terms of service/privacy policy/about/cookie policy sidebar navigation.
• BUGFIX: Fixed infinite loop when finding a File path in a specific case.
• INTERNAL: Made it easier to profile the web servers in production.
• NEW: Account export lets you specify which groups to export data from, and the export is better broken out by group.
• SYSADMIN: Added an additional webserver.
• CHANGE: We now parse a bunch more incorrect Date: header line formats, where the day of the week is spelled out (Monday) and/or the month is spelled out (January).

Have a good weekend everybody.

Mark

Changes to the site this week:

• SYSADMIN: Upgraded the mail email sending machine.
• BUGFIX: When parsing an emoji (":emojiname:") that doesn't exist, the trailing colon would disappear.
• NEW: Timestamps are included in activity log exports.
• NEW: You can export all of your account data.
• BUGFIX: HTML special characters in calendar descriptions were not properly escaped in generated ICS files.
• NEW: You can export the activity log now as part of the export group process, and exports are now logged.
• INTERNAL: Increased nsqd message size limits for large export group archives.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: Increased the seriousness of the maintenance page.
• NEW: You can now export all parts of your group, including chats, files, photos, wikis and calendar events.
• CHANGE: Tweaked the delete group page to make it more explicit which group you're about to delete.
• INTERNAL: Made yahoo group crawler more resilient to Yahoo errors.
• CHANGE: The member not confirmed 'NC' badge is now orchid color instead of light blue.
• BUGFIX: Keep formatting for github commit messages.
• INTERNAL: Optimizations for group transfers.
• BUGFIX: Viewing video attachments didn't work.
• BUGFIX: Fix updating the time for repeating events.
• CHANGE: Fix for change in Yahoo's login process.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: When sending a message to a member and BCC All is checked, we previously would not send the message to a moderator that didn't have the pending message notification enabled. We now always send the message to all moderators.
• CHANGE: Wording tweaks on event notification emails re: RSVPs.
• SYSADMIN: Upgraded Elasticsearch software.
• SYSADMIN: Reconfigured some machines to avoid future downtime.
• BUGFIX: #cal-invite messages to all day events had the end date be one day earlier in the attached ICS file.
• CHANGE: The message sent to members after a group is moved from Yahoo is now from the +owner address, instead of the group address, to prevent inadvertent group replies.

The next #changelog email will be on Friday, May 4th.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: Change the URL sort for database tables to sort by title first, then URL, then description.
• INTERNAL: Upgraded to Font Awesome 5.
• NEW: For premium groups, you can now lock groups/subgroups, making them read-only.
• INTERNAL: Updated the Stripe API library.
• CHANGE: Instead of changing the Message-ID for all recipients, we now only change the Message-ID for the original sender.
• CHANGE: Formatting changes to the view event page for events with RSVPs.
• BUGFIX: We didn't recognize RSS feeds that were served to us in non UTF-8 format. We now fetch feeds and specifically convert them to UTF-8 before passing them off to the feed parser.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: When attempting to change your email address to an address that already has an account, and that isn't just subscribed to updates@, we now offer the ability to merge the two accounts automatically. An email is sent to the to account and that account has to accept it.
• NEW: From the directory, you can send an email to another member. Limited to 2 per day to a specific person, 10 per day total per group.
• NEW: We now keep and display the response from the email server on successful deliveries, in the Email Delivery History pages.
• CHANGE: The group home page month view now takes into account a user's timezone.
• BUGFIX: When editing a poll, the message that gets sent out now starts "A poll has been updated"....
• BUGFIX: Plain text messages had emails obscured even when the group was set to show them.
• CHANGE: Allow padding-left style, to fix indented HTML.
• BUGFIX: Fix page back in group directory.
• BUGFIX: Honor group aliases when processing emails.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: For groups with reply-to set to sender, include List-Post header in single messages.
• NEW: Delete account functionality, without having to contact support.
• BUGFIX: In a plain text message, if someone enclosed a link in < and >, we included the trailing > in the link.
• BUGFIX: Don't send event reminders and notices for cancelled events.
• FIX: Fixed wording in the message visibility sections of the create group and create sub group pages.
• CHANGE: If a wiki has a sidebar or footer, disable the 'Add a Sidebar' or 'Add a Footer' button instead of making them disappear.

Have a good weekend everybody.

Mark

Changes to the site this week:

• NEW: Enterprise groups can customize the HTML on the login page as well as on the send login link page.
• CHANGE: Two factor protected accounts can now use Email Me A Login Link.
• CHANGE: Improvements to the wording of the spam unsub email and moderator notification.
• CHANGE: When editing a wiki page, don't submit the edit on enter in the reason text field.
• CHANGE: When trying to change your email address, if you enter in your existing email address, it will now display an error (previously it was silently ignored).
• NEW: You can now edit the moderator notes of past member records.
• NEW: Display the name of the owner of each photo album.
• NEW: New View Members moderator privilege.
• CHANGE: If a group's Members Visible setting is Owners only, it used to be that we allowed moderators with one of the member change privileges (approve pending members, ban, etc) to also access the Members list. But now, if Members Visible is set to Owners, only owners can access the members list, regardless of whether moderators have those privileges.
• CHANGE: Don't create activity log entries for bouncing or unbouncing someone in banned groups.
• CHANGE: Title and description no longer required for Link database columns.
• CHANGE: Wording changes on Group Settings page for group/message visibility.
• NEW: For enterprise groups, add a link back to Groups.io under the account dropdown in the upper right.
• NEW: For restricted premium/enterprise groups, approving a Not Confirmed pending member now automatically confirms that account as well.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: For the Yahoo group transfer process, enable deleting of the transfer request after the transfer has been completed, so that it can be resubmitted in cases where Yahoo's Files or Photos weren't working at the time of the original transfer.
• CHANGE: For enterprise groups, remove Sign Up link in header.
• BUGFIX: Fixed bounce probe emails to display proper group names with enterprise groups.
• CHANGE: Allow style attributes on h1..h5 when displaying html messages and wiki pages.
• CHANGE: Wording/collapse tweaks to the user sidebar.
• INTERNAL: Streamlined some of the process of getting an SSL cert for new enterprise groups.
• CHANGE: In the post to sub view, also show Pending Subscription notices in the notices selector.
• CHANGE: When viewing a member's delivery history, check the successful delivery cache for a more recent successful delivery than what's in the database.
• NEW: The edit subject page for messages without tags sent to groups that require them has been reformatted, with a selector to select existing tags.
• NEW: Added Messages -> Attachments -> Moderate to group settings, to moderate messages with attachments.
• CHANGE: In a table, don't show a date or time field if it has not been set (ie if a date or time column has been added, and there are existing rows).
• BUGFIX: Muting a hashtag manually didn't work.
• CHANGE: Changing your password now displays a proper 'your password has been changed message' and you're redirected to the home page.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: Clicking a link database table column now takes you to the link, instead of to the view row page.
• CHANGE: Display more information on the Yahoo Transfer page for each In Process transfer request.
• BUGFIX: When viewing a subgroup home page, redirect when one of the unlisted privacy settings, but not otherwise.
• INTERNAL: Improvements to the structured logging of web queries to make it easier to track activity.
• BUGFIX: On mobile, in the Topics/Messages view, the Filter Funnel got pushed to a new line. Fixed.
• BUGFIX: When adding a Reply-To line because of DMARC, use the original From line, email address and name, instead of just email address.
• BUGFIX: Wiki pages were not being incrementally indexed by the search engine. Bug fixed and wiki pages fully re-indexed.
• NEW: You can now cancel an event, which sends an email to everyone who RSVPed Yes or Maybe.
• CHANGE: Removed requirement for sending a login link with an enterprise domain that the person have at least one subscription to that enterprise group. Made it impossible for someone with an account without a password to subscribe to their first enterprise group.
• BUGFIX: Fixed the header when downloading the member list.
• CHANGE: In the members page, changed the Action dropup to a dropdown.
• BUGFIX: Fix stripping 'Sent from my ...' lines in plain text only messages that don't end with a newline.
• NEW: For premium/enterprise groups, you can view past member activity and moderator notes.
• CHANGE: No longer defaulting to send event notices to the group on creation/update.
• BUGFIX: Fix redirect to login when trying to view the private guidelines of a group.

Have a good weekend everybody.

Mark

Changes to the site this week:

• CHANGE: Removed the list of public subgroups from the group home page, as it's a duplicate of what is shown in the Subgroups tab (which also has a better display of them).
• CHANGE: Added more 'Sent from my ' lines to automatically strip.
• SYSADMIN: Upgraded the second web server for more capacity.
• SYSADMIN: Moved one of the two Groups.io DNS servers to a different data center, for redundancy in case our main data center goes off-line.
• INTERNAL: Moved the final part of the system, messages to karld, off the Redis-based queue and onto a nsq-based queue.
• BUGFIX: I mispeled the word committed in several places.
• SYSADMIN: Upgraded the backup database instance to double the memory/disk because we ran out of disk.
• BUGFIX: There was a deadlock when two users viewed the same group calendar at the same time.
• BUGFIX: Editing one event in a repeating event series created extra events.
• NEW: 'All Posts By This Member' in group profile pages.
• NEW: When a user changes their email address to an address taken by an account with no subs (or subbed just to updates@), we now let them take over that email address.
• NEW: Moderators can now change members' email addresses.
• NEW: Moderators can now edit members' signatures.
• CHANGE: More updates to the Yahoo Group transfer process after I learned that many groups do not accept -subscribe email requests.

Have a good weekend everybody.

Mark