Topics

yG Privacy Dashboard download #yahooprivacydashboard #ioimportpl

 

The banner on yahooGroups pages links to
https://help.yahoo.com/kb/groups/SLN31010.html?impressions=true

There I clicked "How can I keep my Yahoo Groups content?", got:
"Photos and files can be saved right from the Yahoo Groups site,
or you can download your data from the Privacy Dashboard"
https://help.yahoo.com/kb/groups/download-data-privacy-dashboard-sln28671.html

On October 16 I clicked "Visit the Privacy Dashboard page", yahoo!, Groups,
the three blue dots to the right near the top,
the link to https://groups.yahoo.com/neo/getmydata , "Email the code",
entered the code, Download.

Today (Oct 26) I got an email and downloaded a 1.4 GB file.
It contained Messages and Files from all groups I'm a member of, but no Photos.
Not only my messages, but all messages, including full email addresses,
in mbox format. Incliding GMF (76 MB zipped), YGOG, LH.
And all Files and Links.

--
Lena

Tom H
 

I made the same request around that time and received a download link today.

Tom H
 

But when I logged in and got to the download page:

Your Yahoo Groups data

Your download request has been completed, but no data of this type is available in your account.

 

 

Lena
Was the download divided into separate groups? And was each
Group separated into files and messages?

We have to manually upload to a group here because there’s an absentee owner at the yahoo group.

Depending on how this download is put together it could be a huge help to this group here.

Thank you
Susan B

On Oct 26, 2019, at 2:53 AM, Lena <@Lena> wrote:

The banner on yahooGroups pages links to
https://help.yahoo.com/kb/groups/SLN31010.html?impressions=true

There I clicked "How can I keep my Yahoo Groups content?", got:
"Photos and files can be saved right from the Yahoo Groups site,
or you can download your data from the Privacy Dashboard"
https://help.yahoo.com/kb/groups/download-data-privacy-dashboard-sln28671.html

On October 16 I clicked "Visit the Privacy Dashboard page", yahoo!, Groups,
the three blue dots to the right near the top,
the link to https://groups.yahoo.com/neo/getmydata , "Email the code",
entered the code, Download.

Today (Oct 26) I got an email and downloaded a 1.4 GB file.
It contained Messages and Files from all groups I'm a member of, but no Photos.
Not only my messages, but all messages, including full email addresses,
in mbox format. Incliding GMF (76 MB zipped), YGOG, LH.
And all Files and Links.

--
Lena


 

Lena
I just requested a download of my information from yahoo. You said you received all messages and files from groups you belong to. I read up on what mbox format is. Is this something you think I can upload to a group here? We want to put all our old posts, which contain very valuable information, into our new group here either on the message board or in the files. Message board is preferred. We were going to just start forwarding each old message to the message board here, starting with the oldest. It would be a daunting and very lengthy task.

Susan B

On Oct 26, 2019, at 2:53 AM, Lena <@Lena> wrote:

The banner on yahooGroups pages links to
https://help.yahoo.com/kb/groups/SLN31010.html?impressions=true

There I clicked "How can I keep my Yahoo Groups content?", got:
"Photos and files can be saved right from the Yahoo Groups site,
or you can download your data from the Privacy Dashboard"
https://help.yahoo.com/kb/groups/download-data-privacy-dashboard-sln28671.html

On October 16 I clicked "Visit the Privacy Dashboard page", yahoo!, Groups,
the three blue dots to the right near the top,
the link to https://groups.yahoo.com/neo/getmydata , "Email the code",
entered the code, Download.

Today (Oct 26) I got an email and downloaded a 1.4 GB file.
It contained Messages and Files from all groups I'm a member of, but no Photos.
Not only my messages, but all messages, including full email addresses,
in mbox format. Incliding GMF (76 MB zipped), YGOG, LH.
And all Files and Links.

--
Lena


 

On Sat, Oct 26, 2019 at 04:20 PM, Susan B wrote:


Was the download divided into separate groups? And was each
Group separated into files and messages?
Yes, yes. File descriptions are missing, each file is separate with its own name in its folder (zipped).

We have to manually upload to a group here because there’s an absentee
owner at the yahoo group.
You can upload the mbox file. Members can download the file and use Thunderbird or another mail client to read it and search in it.

We were going to just start forwarding each old message to the message
board here, starting with the oldest. It would be a daunting and very lengthy
task.
There are different types of forwarding. If "From" in a forward is of the person doing the forwarding then every message will be from that member. If "From" is preserved but that email address isn't currently subscribed to the .io group then the message will be moderated (assuming that "Allow Non Subscribers to Post" is checked in group settings) and thus out of order.

I'm thinking to write a program (in Perl language) to read a mbox and email each message to groups.io (direct-to-MX, requires your IP-address to have RDNS) in order. The program should be able to handle timeouts, temporary rejections (4xx) and use optional list of pairs: email address in yG archive -> current email address of that person subscribed to the .io group. Also an option to take list of email addresses of all current members, if "From" of a message in the mbox is not in the list then change "From" to some fixed address (like owner's) in order to avoid moderation.

I'm sure that somebody here will be able to describe step-by-step how to run a program in Perl under Windows using ActivePerl or something similar.

 

Lena,
I know you are a whiz with computer programming from past messages of yours I’ve read. I don’t know that much about it but I like to read about the possibilities and their details - such as you provided. I liked your idea that there should be a way to create a program that will do what you described. I notice you were talking about Perl. We have one member using a PC who is willing to help with the forwarding. I am using a Mac…. is it possible to write something for a Mac that does what you describe?

Thank you -
Susan B

On Oct 26, 2019, at 9:58 AM, Lena <@Lena> wrote:

On Sat, Oct 26, 2019 at 04:20 PM, Susan B wrote:


Was the download divided into separate groups? And was each
Group separated into files and messages?
Yes, yes. File descriptions are missing, each file is separate with its own name in its folder (zipped).

We have to manually upload to a group here because there’s an absentee
owner at the yahoo group.
You can upload the mbox file. Members can download the file and use Thunderbird or another mail client to read it and search in it.

We were going to just start forwarding each old message to the message
board here, starting with the oldest. It would be a daunting and very lengthy
task.
There are different types of forwarding. If "From" in a forward is of the person doing the forwarding then every message will be from that member. If "From" is preserved but that email address isn't currently subscribed to the .io group then the message will be moderated (assuming that "Allow Non Subscribers to Post" is checked in group settings) and thus out of order.

I'm thinking to write a program (in Perl language) to read a mbox and email each message to groups.io (direct-to-MX, requires your IP-address to have RDNS) in order. The program should be able to handle timeouts, temporary rejections (4xx) and use optional list of pairs: email address in yG archive -> current email address of that person subscribed to the .io group. Also an option to take list of email addresses of all current members, if "From" of a message in the mbox is not in the list then change "From" to some fixed address (like owner's) in order to avoid moderation.

I'm sure that somebody here will be able to describe step-by-step how to run a program in Perl under Windows using ActivePerl or something similar.

Sarah k Alawami
 

<div style="font-family: sans-serif;">
<div>
<p>Yes you can. You will have to email those to Mark. I did this with my mail man transfer in 2016. And the transfer happened in a few days. This was before the yahoo debacle so give it time.</p>
<p>Sarah Alawami, owner of TFFP. .</p>
<p>On 26 Oct 2019, at 6:17, Susan B wrote:</p>
<blockquote>
<p>Lena<br />I just requested a download of my information from yahoo. You said you received all messages and files from groups you belong to. I read up on what mbox format is. Is this something you think I can upload to a group here? We want to put all our old posts, which contain very valuable information, into our new group here either on the message board or in the files. Message board is preferred. We were going to just start forwarding each old message to the message board here, starting with the oldest. It would be a daunting and very lengthy task.</p>
<p>Susan B</p>
</blockquote>
</div>
</div>

 

Did you check boxes for things that you never used, like news, for instance? There were really very few things out of the long list you see that I wanted. I noticed I got a separate reply from Yahoo for each box I checked. If I had checked any box where I had no data I would expect to get a reply saying that there was no data to download.

Susan B



On Oct 26, 2019, at 8:20 AM, Tom H <ve3meo@...> wrote:

But when I logged in and got to the download page:

Your Yahoo Groups data

Your download request has been completed, but no data of this type is available in your account.

 

Sarah Shapiro
 

I requested download today and got this:

It may take up to 30 days for this download to become available.

By that time I hope to have made progress on my own in copying my important group's files!


Donald Hellen
 

On Sat, 26 Oct 2019 21:14:07 -0400, "Sarah Shapiro"
<sarahseventytwo@...> wrote:

By that time I hope to have made progress on my own in copying my important group's files!

You can use PG Offline to do that. It takes a little setup but once
you do, it will automatically download files and the folders in your
files section, links, photos, and if you set it up right from the
start, the messages.

As of right now there is no facility to upload those messages to your
GIO group but that might be available shortly.

Donald

Sarah Shapiro
 


In response to my noting that Yahoo advised that it would be 30 days before
Dashboard download would take place, Don suggested:

You can use PG Offline to do that.

Well, not exactly.  I used PGO to download the 14 Links of a small group, and got only
the names of the links, not even the URLs.  I did it only to see what happened before
I tried PGO for a much larger group.  Copy and paste will serve my needs far better!

 

On Oct 26 I wrote:

The banner on yahooGroups pages links to
https://help.yahoo.com/kb/groups/SLN31010.html?impressions=true

There I clicked "How can I keep my Yahoo Groups content?", got:
"Photos and files can be saved right from the Yahoo Groups site,
or you can download your data from the Privacy Dashboard"
https://help.yahoo.com/kb/groups/download-data-privacy-dashboard-sln28671.html

On October 16 I clicked "Visit the Privacy Dashboard page", yahoo!, Groups,
the three blue dots to the right near the top,
the link to https://groups.yahoo.com/neo/getmydata , "Email the code",
entered the code, Download.

Today (Oct 26) I got an email and downloaded a 1.4 GB file.
It contained Messages and Files from all groups I'm a member of, but no Photos.
Not only my messages, but all messages, including full email addresses,
in mbox format. Incliding GMF (76 MB zipped), YGOG, LH.
And all Files and Links.
On Oct 26 I deleted the downloaded file from yahooGroups website
and requested the download again. On Nov 2 the second download was ready.
This time it contained photos uploaded only by me
but messages (with full email addresses) and Files from all members
for all groups where I'm a member (not only where I'm moderator or owner).

I wrote a program to import messages downloaded from yahooGroups this way
into a .io group or subgroup via email.
Import is slow because soon groups.io says:

500 We have received more than 40 messages in 30 minutes from you. To guard
against autoresponder mail loops, we must reject additional messages from you
temporarily. Please try again later.
Here "you" means email address in "From" of message to import.
After the backlog of importing "easy group transfer" clears in December,
users of my program can petition Mark to exempt from this check
if "HELO import.messages.from.yahoogroups"
(it's how my program identifies itself to groups.io).

You can download this my program from
http://lena.kiev.ua/ioimport.zip

Instructions are in the beginning of the program,
here I copy them:

# Import yahooGroup messages downloaded from Privacy Dashboard
# into groups.io via email direct-to-MX.
# Your IP-address must have RDNS; your ISP must not block port 25.
# How to check RDNS: on http://hostip.info there must be something after
# "Host name:", or else groups.io refuses mail directly from your computer.
# In such case you can run this program on a web-hosting,
# invoking it with a web-browser.

# This program can be used under Windows, MacOSX, Linux, FreeBSD etc.:
# 1. Unzip the download from Privacy Dashboard
# https://groups.yahoo.com/neo/getmydata
# (only the file messages.zip is used).
# 2. Create a directory (folder), if under Windows then C:\perl
# Everything will be in that directory.
# 3. (only Windows) download to that directory and unzip:
# (32bit) http://strawberryperl.com/download/5.14.4.1/strawberry-perl-5.14.4.1-32bit-portable.zip
# or (64bit) http://strawberryperl.com/download/5.14.4.1/strawberry-perl-5.14.4.1-64bit-portable.zip
# 4. Unzip the ioimport.zip file with this program
# and the messages.zip file (containing one or more files) into same directory.
# 5. Subscribe a new email address to the .io group, in Members set its
# display name to single dot. Messages from currently non-members
# and moderated members will be imported with that email address in "From:",
# original email address inserted into the top of message body.
# 6. From your group on groups.io website in Admin - Members right-click the
# Download button, save memberlist.csv into the same directory;
# 7. in Admin - Settings, Moderated must not be checked;
# 8. in Hashtags press Create Hashtag, enter #mi , check No Email
# and press Create Hashtag ("mi" means "message import").
# 9. Run this program (if under Windows then run portableshell.bat in that
# directory, type
# perl ioimport.pl
# and press Enter), it creates needchange.txt file with email addresses
# from the messages to import which are currently not subscribed
# to the .io group, or moderated, or have another problematic status.
# 10. You can optionally create (in the same directory) map.txt file,
# each line with two email addresses (separated with blanks, tabs or commas):
# email address in yahooGroup archive (from needchange.txt)
# and email address of the same person currently subscribed to the .io group.
# 11. Run the program again, look again into needchange.txt file.
# You can add to map.txt and run this program again several times.
# 12. In the same directory create file fromto.txt with one line with
# two email addresses: the email address you created and subscribed
# and email address of the .io group or subgroup.
# 13. Optionally run the program again, it sends an email to +help
# in order to check that it can email to groups.io directly from your computer
# (that your ISP doesn't block port 25 and your IP-address has RDNS).
# The mailbox you subscribed should receive an email with Subject beginning
# from "Automated help for the".
# 14. In the same directory create goahead.txt file (with empty content
# or any content).
# 15. Run this program again, import begins. If it fails, you can run
# this program again as many times as needed, it'll skip already imported
# messages and resume from the failed message.
# 16. Delete the fromto.txt file
# and the files with .mbox. in their names extracted from messages.zip
# (they would be wrong if you want to import messages from another yahooGroup).
# 17. On groups.io website in Hashtags under #mi press Edit, Delete, Yes.

# version 1 November 2019 Lena @ lena.kiev.ua BSD license
# Perl 5 (any version)

--
Lena

Morgan Dawn
 

Several of us are seeing the same problem when we log in and got to the download page:

Your Yahoo Groups data

Your download request has been completed, but no data of this type is available in your account.


We have deleted the request and resubmitted and still get nothing back

One person logged in, saw her data, came back a day later and it was gone.

BMaverick
 

Most of our members had gotten the 'no data' as well.  That's when we knew to jump onto the PGOffline tool after reading the PGOffline forums and how well the software worked. 

We were able to grab ALL of our data, files, messages, photos, database, etc. 

Then there were spin off groups over the years, 3 of them actually.  We didn't have to pay again or again or again to snag all of the spin off groups. 

Next we took all of the messages and saved them as archive FILES.  HTML, .ods, .csv, and .xlsx  This way, a person can search and filter to a certain topic, subject or keyword(s) very quickly.  Actually faster than poking around on Yahoo for the most part.

isis feral
 

I don't know if anyone else is still paying attention to this topic, or if my question might be answered elsewhere, but I finally got my Yahoo Groups data today. I tried repeatedly to download it, but the download got interrupted, apparently because my login expired. Seems it expires within about an hour, and there's no way I can download a couple of GB that fast. I can barely download a couple hundred MB before I get an authentication failure error message. Has anyone figured out a workaround to this?

Otherwise i will try at a friend's house in a couple of days, and hope her connection can download it much faster, provided my data is still there....

BMaverick
 

ISIS,

To help with the download speed, DO NOT use WiFi.  WiFi cuts the speed by almost half.  Instead run the correct cable from the WiFi router to your computer.  Now you can download at much higher speeds.

BMaverick

isis feral
 

Thanks, BMaverick.

I actually don't use WiFi at all usually, or any wireless technology. I'm completely wired at my house, but my DSL connection is the slowest version there is, so a couple of GB take an entire day to download. I didn't see your response before I went to my friend's, but I'm happy to report that her WiFi connection got the job done. Just barely downloaded it all in an hour, so just under the wire (no pun intended). I don't think I would have been able to connect the cable there, since it's a shared connection, with the router far away from the computer. Very relieved it worked out though.

As I'm unzipping the files, I can see that all my groups are represented, but I can't yet figure out if it's all the messages of each group, or just my own. There are many more folders within the folders that need to be unzipped, so that's going to take a while, and then I have to figure out how I can actually look at them. I thought it would be JSON files, but it don't see any file extension, though the file names say MBOX, so I'm a little confused about how to open them.

Derek Milliner
 

Isis,

MBOX format is a standardised format for, well, mailboxes. Personally I use the Thunderbird email client (free) (https://www.thunderbird.net/) with the 'ImportExportTolls NG' add-on (also free) which knows how to read & write mbox files. Other tools/mail clients are available!

Regards,

Derek

Duane
 

On Thu, Nov 28, 2019 at 07:03 AM, Derek Milliner wrote:
MBOX format is a standardised format for, well, mailboxes.
If you plan to have the mbox file imported by GIO, please note the details at https://beta.groups.io/g/main/message/22966

Duane
--
Help: https://groups.io/static/help
GMF's Wiki: https://groups.io/g/GroupManagersForum/wiki
Search button at the top of Messages list
A few site FAQs: https://groups.io/static/pricing#frequently-asked-questions