Changes to the site this week:

• CHANGE: Got Yahoo Group exports working again.
• INTERNAL: Revamped activity log definitions to make it easier to add new activities.
• CHANGE: Tweaked the default welcome message template to make things more clear (will only be applied to groups created after this).
• CHANGE: In the activity log, changed instances of 'modified' to 'updated' for consistency.
• CHANGE: Revert to previous behavior of treating web posts as new topics.
• BUGFIX: The URL in the emails sent when someone reports a photo were incorrect.
• CHANGE: For Enterprise domains, changed how we do Facebook/Google logins. We now do them via the groups.io domain, to avoid having to whitelist every domain we serve and also because we were running up against a limit with Google in terms of number of domains served.

Have a good weekend everyone.

Mark

Changes to the site the past couple of weeks:

• CHANGE: If you click the Clear button after filtering archives, it will now take you back to /topics or /messages (as appropriate), instead of keeping you in /search.
• CHANGE: From the activity log, clicking on an added/modified file used to bring you to the enclosing folder. I've added a folder icon next to the file name that does that now, and clicking on the file takes you directly to the file.
• BUGFIX: When viewing an individual +owner message, the pending messages permission was required, which was inconsistent with other pages.
• CHANGE: Changed default subject line for message rejection notices from 'Your message was rejected' to 'Your message was not approved'
• BUGFIX: Fixed screen reader access on the create and edit hashtag pages.
• CHANGE: Wording improvements to the Send Log In Link page (thanks Shal!)
• INTERNAL: Upgraded production to use go 1.11 compiler.
• INTERNAL: Parallelized message generation when viewing /topic or /messages to speed up web response.
• INTERNAL: Added a database index to speed up deleting of topics.
• INTERNAL: Change the database code to make it seamless when doing database schema changes.
• CHANGE: Add group upgrade options for non-profit enterprise pricing, to allow self-service non-profit upgrades.
• CHANGE: Previously we would treat web posts as new topics, regardless of whether they had the same subject as a previous topic. This was different from how we treat email messages, where we combine new messages into existing topics when we can. Now we do the same for web posts.
• INTERNAL: Cleanups of various database structures/repaying some technical debt

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX (in process): Changed how we store the name of the person who originated a topic to fix a couple of bugs that would cause the person's name to not be displayed on the Topics page. Database is currently being updated to support the fix.
• CHANGE: 'Public Groups' -> 'Publicly Listed Groups'
• NEW: We are now dropping all email from numbered qq.com addresses, and we treat such addresses as invalid when registering on the website.
• NEW: In addition to a cover photo, a group can now have an icon. It's currently used only on the mobile home page.
• BUGFIX: We were not re-writing gmail.com From addresses for senders that did not have 'I always want copies of my own emails' checked.

Have a good weekend everyone.

Mark

Changes to the site this week:

• INTERNAL: Moved from Grafana to Chronograf for metrics dashboards.
• NEW: Added advanced subscription option badges to the Delivery column in the Groups page. Also, did some reformatting.

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: We would not display messages correctly if they were plain text only and had a really long line.
• CHANGE: Text changes to the Update File/Update Folder dialogs in the Files section.
• NEW: Added advanced subscription option badges to the Delivery column in the Members page.
• BUGFIX: Changed the included ICS attachment in event notification emails to work around a Gmail bug that would sometimes display one part of a repeating event with the wrong day.
• BUGFIX: Made checkboxes for moderator/owner notifications screen reader accessible.
• CHANGE: Because of a policy change at Gmail, we are now re-writing the From line for messages sent back to senders that have gmail.com email addresses.
• CHANGE: Show your email address in the footers for digests and summary emails.
• CHANGE: Tweaked the wording a bit on the Yahoo transfer page.
• NEW: If there is an error adding an email alias, don't collapse the email alias display (which hides the error).
• NEW: Use the group default time and date format settings when generating event notice/reminder emails.
• INTERNAL: Unbounced Cox.net members who had been bounced over the past 30 days (because of Cox's email issues).
• NEW: Now tracking bounce probe deliveries.
• BUGFIX: In some instances we would send a daily summary to a pending subscriber.

Have a good weekend everyone.

Mark

Changes to the site this week:

Web:

• NEW: We extend expiration of the login cookie each time a person accesses the site.
• NEW: We have a new, non-expiring cookie that we use to determine when someone has previously been logged in, but whose cookie is now expired. In that case, we redirect the user to the login page, with a banner explaining that their login has expired.
• INTERNAL: In some situations we were not deleting all S3 data associated with a group when the group was deleted.
• BUGFIX: Topic/Message filter by custom date range didn't work if your date format preference was other than MM/DD/YYYY. Fixing this introduced another bug which caused dates to not be shown in the Topics screen.
• CHANGE: Text changes to the Yahoo Transfer screens to make things more clear - thanks Shal.

Have a good weekend everyone.

Mark

Changes to the site this week:

Web:

• SYSADMIN: Increased heap memory of search nodes to hopefully stop random crashes.
• BUGFIX: Reply to sender on the web to a non-member of the group produced an error.
• BUGFIX: Reply to Group & Sender on the web in some cases did not send the message to the sender, only to the group.
• CHANGE: Tweak the formatting of photo album descriptions to allow for longer descriptions.
• BUGFIX: Some Facebook posts would duplicate the first image.
• CHANGE: Bolded the current page in the pagination links.
• BUGFIX: Fixed a couple of broken links in the More menu on mobile.

API:

• NEW: New subscription_plus field: nice_group_name.
• NEW: New /gettopics parameter: extended.

Have a good weekend everyone.

Mark

Changes to the site this week:

Web:

• No changes

API:

• CHANGE: The /downloadarchives endpoint has been temporarily disabled because a company was abusing it and putting too much load on the system.
• NEW: The /gettopics endpoint now works.
• NEW: Additional error codes for /login API endpoint.
• NEW: Added group_alias, org_id, org_domain fields to the 'subscription_plus' object.

A note on my focus for the next few months: https://beta.groups.io/g/main/message/18909

Have a good weekend everyone.

Mark

Changes to the site this week:

• CHANGE: Changed the Action menu in the Members page, pulling email delivery and moderation options into dialogs. This makes the Actions dropdown smaller, so it works better on mobile, and is preparation for other options being added.
• NEW: When viewing an event, show the person who created the event.
• NEW: Added event organizer information to event reminder emails.
• CHANGE: Changed how messages are sorted in digests. We now sort by date and then group by topic, which is slightly different from before. Now, the date of the first message we're showing in the topic determines the sort order of the topic, not the date of the first message ever in the topic.
• BUGFIX: We were not properly escaping newlines in the DESCRIPTION field in ICS files.
• BUGFIX: For tables with HTML Paragraph columns that were not the first column, the HTML edit widget was not properly initialized when adding/editing a row.
• CHANGE: When viewing a photo, the links to next/previous photos now extend the full height of the photo.
• BUGFIX: The Subscribe to Calendar button was improperly disabled for some subgroups.
• BUGFIX: Fix table csv imports of addresses, where the city field was being populated by the address line 2.
• CHANGE: Only display the Email link on a member's profile if the group's directory is visible to members.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Topics can have a reply to setting that overrides the group's reply to (and any associated hash tags).
• NEW: Replaced the Reply To Sender Only checkbox on hashtags with a dropdown, allowing you to override the group's reply to setting.
• NEW: When a subscriber is viewing a member's profile, display the Email button to send them an email.
• CHANGE: You can now like messages in topics that are closed (matches email behavior now)
• BUGFIX: Crash fix for database map view when geocoding cannot find a proper lat/long for an address.
• BUGFIX: Crash fix when exporting event responses.
• INTERNAL: Updated logrus logging package and fixed the logging when running a web server in development.

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: When direct adding someone to a parent group and at least one subgroup that has a direct add message, we weren't not sending out the subgroup's direct add message.
• BUGFIX: When adding a member to a subgroup, we weren't including the direct add message, if one was set.
• BUGFIX: For groups set to moderate messages with attachments, the Emailed Photos album would not show up.
• BUGFIX: For certain database table searches, only the first page would be displayed. Other pages would be blank.
• API: Return group_name with subscriptions.
• CHANGE: For pending message notification emails, add a link at the top to view the message online.
• CHANGE: If a topic has a tag that is moderated, make sure we display the moderated icon in the Topics view for that topic.
• CHANGE: Updated the list of not permitted groups on the create group page.
• NEW: First pass at a help section for the upcoming group payments system.
• CHANGE: For the event and reminder emails, for all day events that last more than one day, show both start and end days (we previously only showed the start day).
• BUGFIX: For a pending message sent from a subscriber who then unsubscribes before the pending message is viewed, do not show the View Member/Send Message buttons.
• BUGFIX: When editing a database row, when you return to view the previous page, the per page setting was ignored.
• BUGFIX: If a topic is locked and has a hashtag that is set to reply to sender only, replying on the website was not permitted.
• BUGFIX: The web server would crash when viewing a past member that had been subscribed to a subgroup that no longer exists.
• NEW: In HTML digests, there are now hashtag mute links in the message footers. I also did some editing of the text of the other links, removing some words to make space.
• NEW: In the group Hashtags page, each hashtag now has a Mute/Unmute link.
• CHANGE: Reformatted the mute/unmute hashtag pages to match modern style.
• BUGFIX: If you are the owner/moderator of a parent group viewing a poll in a subgroup that you are not subscribed to, you should not be permitted to vote in the poll, because votes are keyed to subscription records.
• BUGFIX: If multiple owners voted in a subgroup poll, the count and display would be off in the View By Answer poll view (only one owner's vote(s) would be displayed).

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: In some instances emailed images were not appearing in the Emailed Photos folder. Also reindexed the message archive.
• INTERNAL: Work on adding the ability for group owners to charge subscriptions to groups.
• CHANGE: When converting inline images into attachments, verify that a valid media type is specified before doing the conversion.
• CHANGE: Members now have 7 days instead of 3 days to auto-resubscribe after having been removed because of spam reports.
• INTERNAL: Fixed SSL certificate renew mechanism.
• NEW: New activity log messages for when a member sends a message with a new tag (in a group where new tags are restricted), a message with a tag only moderators can use, and a message without any tags (where tags are required).
• BUGFIX: For groups with attachments moderated, the add photo/add attachment buttons were not being displayed in the HTML editor.
• CHANGE: Improved file search to allow for partial name matches.
• BUGFIX: It was possible to ban a non-valid email address.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Photo search.
• CHANGE: Cleaned up and modernized all the photos pages.
• CHANGE: Ignore any autoreply headers if the message is to an email integration (normally we would drop those messages).
• BUGFIX: Fixed the email address and URL in the bounce message for messages sent to enterprise groups where you are not subscribed.
• NEW/TESTING: You can define a Display Template to specify how database tables are displayed. This is in limited testing for the moment.
• NEW: New database column type 'HTML Paragraph'.
• SYSADMIN: Replaced a badly behaving webserver.
• SYSADMIN: Updated nsqd on all machines.
• INTERNAL: More infrastructure work to make it easier to bring up new machine instances.
• CHANGE: Cap images at a max of 10k per side, regardless of group setting.

Have a good weekend everyone.

Mark

Changes to the site this week:

• BUGFIX: Fixed a bug in the /downloadarchives API endpoint.
• CHANGE: Added a bunch of panels to Account, Edit Sub and Member pages to try to make things more clear. Also worked on some of the descriptions.
• BUGFIX: The 'To' header line of Email Integrations contained an invalid email address.
• NEW: Made the database table map view display much quicker, without the flickering as it loaded the map.
• NEW: New member post status overrides: Override: moderate the first message of every topic this person starts and Override: moderate all topics started by this person
• API: New subscription post_status values: sub_poststatus_modfirstmessage, sub_poststatus_modstartedtopics
• CHANGE: Made New Poll a tab in the sidebar instead of a button on the New Topic page.
• NEW: Respect column colors in table map views.
• NEW: In a table map view, we now pop up a title when mousing over a pin.
• NEW: In a premium group, when viewing a table with an address, changed the toggle buttons between map and list views.
• NEW: Upgraded to Fontawesome 5.3.1
• BUGFIX: In a premium group, when changing the sort of a table with an address in list view, it'd go back to map view.
• MISC: Cleaned up a lot of CSS on the website and made all the icons a consistent type.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Add the group subject tag to the subject of private replies.
• NEW: When direct adding people to a parent group and subgroups, only send out one direct add notification to each member.
• CHANGE: Added text to banner that is displayed when invites or direct adds need to be approved to hopefully explain things better.
• INTERNAL: Added support for postgresql integer arrays.
• INTERNAL: Upgraded the postgresql go package.
• BUGFIX: There was a bug in the subgroup display page when categories are set up that could cause groups in the same category to not be displayed together.
• CHANGE: On the pending message page, display the 'Ban Sender' even for existing members.
• BUGFIX: For some reason, Google lost our geocode API key, which prevented the database map view from working. Had to recreate the key.
• CHANGE: When rejecting a pending subscription by email, ignore the request if the subscription is not, in fact, pending (ie it's been approved already).
• NEW: New group setting, Viruses, to set whether messages with viruses are blocked or moderated.
• API: New group field: HandleVirus
• CHANGE: Do not log a change in user or display name in the activity log of any group the user is banned from.
• CHANGE: In activity log, change "Rejected message" to "Message rejected".
• BUGFIX: Pending subscriptions older than two weeks were not being deleted.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: If NormalizeHTMLEmails is set, normalize any added member signatures as well.
• NEW: Added 'TR:' as a subject reply indicator.
• CHANGE: Made our Message-ID header line parsing code smarter, to deal with a crazy message-id of the form "salkdjjks@alksjdklas (extra unexpected stuff here)"
• CHANGE: Now removing any erroneous nulls from decoded message subject lines.
• CHANGE: When exporting Yahoo Groups, scan messages for U+FFFD characters and remove them.
• INTERNAL: Work on automated provisioning/configuration of new machines.
• SYSADMIN: Created a new, larger search cluster, and reindexed the site.
• BUGFIX: Added missing 'Reply To Group & Sender' option in full digests.
• BUGFIX: When aliasing a hashtag to another tag, existing topics were not being properly updated in the search index. So searches on the aliased-to tag would not show the aliased-from topics. This was due to two issues in how we were updating the search index.

Have a good weekend everyone.

Mark

Changes to the site this week:

• INTERNAL: Tested database backups.
• INTERNAL: Changed the internals of the database APIs to better deal with the new connection pooling system.
• CHANGE: Tweaked the wording of 'Default Post Policy' and 'Default group policy' to be more clear.
• BUGFIX: Couldn't delete a topic that had previously had a hashtag that had been deleted.
• BUGFIX: Fixed a race condition in the test topics page when deleting topics.
• CHANGE: In the Files section, display the Updated field instead of the Created field for Uploaded date.
• CHANGE: Disable Action button on Members page if no members are selected.
• CHANGE: Tweaked URL text in confirmation email to match the URL itself.

Have a good weekend everybody.

Mark

Changes to the site this week:

• BUGFIX: Fix encoding issues with CSV formatted member list download.
• CHANGE: The pending message notification email now uses the pending message's subscriber email address instead of the Sender line when describing who the message is from.
• CHANGE: On the Members page, only bring up the Action dialog if at least one member is selected.
• NEW: Include in the activity log the message sent to someone when directly adding them, similar to how invites are done.
• INTERNAL: Fixed database connection closing issue.
• INTERNAL: Moved all database connections to use a connection pooler.
• CHANGE: Help file tweaks.
• BUGFIX: Fixed two issues with chat that could cause chat messages to not be delivered to all members of the chat room.
• NEW: The member subgroups page now has a Joined column for the subgroups a member is a part of.
• SYSADMIN: Tuned the database.
• NEW: Added 'Int' and 'NS' badges to the pending messages page for messages from Integrations and Non Subscribers.
• BUGFIX: Fixed issue with approving pending messages from non-subscribers.
• BUGFIX: Fixed an issue with long running chat sessions.
• INTERNAL: Now caching some web pages.

Have a good weekend everyone.

Mark

Changes to the site this week:

• SYSADMIN: Upgraded the main database instance.
• BUGFIX: For groups without subgroups, you can now go to https://groupname.groups.io, and it will redirect correctly.
• BUGFIX: Fixed escaping of special characters in search query strings.
• BUGFIX: Fixed two bugs in the DKIM verifying library we use.
• BUGFIX: The 'Bulk Remove' button was being shown to some moderators who didn't have the right permission to use it (they were not able to actually use the feature).
• NEW: Added a section to the Help about the FBL and people being removed because of spam.
• NEW: When viewing a subgroup where you aren't subscribed, but you are a mod/owner of the parent group, the tag on the sidebar will now say 'Parent Mod' or 'Parent Owner'.
• CHANGE: Tweaked the sidebar width in certain instances, making it a little larger.
• BUGFIX: Disabled the 'Subscribe to Calendar' button for subgroups where you are not a subscriber (but are owner of the parent group).
• CHANGE: Parallelized updating the DNS servers to speed subgroup creation up.
• BUGFIX: Fixed a problem with repeating event reminders that could cause some of them to not be sent.
• BUGFIX: Fixed some labels on the group settings page for screen readers.
• CHANGE: Added wording on Display Name edit pages: "Note: When you post, your email address is also shown to group members who receive messages via email."
• NEW: On the pending message screen, if you use the Approve & Unmoderate Button to approve messages from non subscribers, a dialog will now pop up telling you that these people cannot be unmoderated (because they're not members).
• CHANGE: Upgraded Go toolchain from 9.4 to 10.3. This unexpectedly broke several parts of the web site that dealt with uploading files. Fixed.
• SYSADMIN: Upgraded main bastion host.
• CHANGE: Don't fig leaf email addresses when viewing source.
• NEW: Adding Authentication-Results header line showing DKIM/SPF tests. Only visible when viewing message source in the archives.
• SYSADMIN: Renewed *.groups.io ssl certificate.
• CHANGE: When posting a message, ignore returns clicked when editing the subject.
• BUGFIX: When viewing or editing an individual database row that has a date column, the date displayed would always be today.
• BUGFIX: When viewing or editing an individual database row that has an empty date column, the date displayed would always be today.

Have a good weekend everyone.

Mark

Changes to the site this week:

• NEW: Replaced the 'Only Moderators Can Create Hashtags' checkbox with a dropdown, allowing messages with new hashtags to be either bounced, or the new hashtags to be removed.
• API: Changed group field: restrict_create_hash_tags is now hash_tag_permissions.
• SYSADMIN: Fixed log rotation issues on the DNS servers.
• NEW: When exporting group data, you can now export hashtag data.
• SYSADMIN: Now serving the cookie consent js/css code locally instead of from a CDN, because that was timing out.
• OTHER: Sent out the GDPR Privacy Policy update email. Dealt with a bunch of angry responses.
• INTERNAL: Deleted all user accounts not subscribed to any groups (or only subscribed to updates@) that were at least one month old.
• BUGFIX: Fix internal crash when a non-moderator of a subgroup rejects via email a pending message.
• BUGFIX: The FBL processing code was ignoring reports from some domains.
• CHANGE: Better behavior when uploading multiple files and one of them is a duplicate of an existing file. Previously we would disgard all files in the upload. Now we keep all of them up to the point of the duplicate.
• BUGFIX: If a file was renamed with either / or \ in the name, the file would be unlinked and unreachable. Fixed the bug and re-linked the affected files.
• INTERNAL: Made exportuser and exportgroup more reliable when dealing with large amounts of data.

Have a good weekend everyone.

Mark