Dramatic drop in users in xml files

Bok
Bok
Joined: 11 Nov 04
Posts: 9
Credit: 2276534
RAC: 0
Topic 217568

Was the opt-in box for consent to be in xml just enforced in the last 24 hours?

I'm showing a drop from ~ 469000 users in the user.xml file down to only 2619 right now..though the tables.xml still shows <nusers_total>468757</nusers_total>

I've put in a deferral at the free-dc stats to not delete these immediately for now, but they will delete in the next day or two

 

 

Shawn Kwang
Shawn Kwang
Joined: 3 Nov 15
Posts: 289
Credit: 3065924
RAC: 1567

You are seeing the effect of

Yes.

You are seeing the effect of the new statistics export option and that we are now enforcing this within the stats. exports themselves. The behavior you are seeing is correct: that nusers_total reports the total number of users, but that the user.xml file only reports users who have consented to the stats. exports, which as you see is a much smaller number.

This configuration is the new setup going forward. The opt-in went into effect 17 December 2018.

Also: Moved this thread to Problems and Bug Reports.

Einstein@Home Project

archae86
archae86
Joined: 6 Dec 05
Posts: 3157
Credit: 7226484928
RAC: 1075661

In what I assume is an

In what I assume is an outcome related to these changes, I noticed that BOINCStats today suddenly reports a big upgrade to my reported world position, world position based on RAC, and the corresponding rankings for individual machines.  I supposed BOINCStats either lacks access to or does not successfully use anonymized data it could use to provide correct rankings under the new scheme.

Betreger
Betreger
Joined: 25 Feb 05
Posts: 992
Credit: 1592222351
RAC: 773918

Yep, this sucks

Yep, this sucks

Bok
Bok
Joined: 11 Nov 04
Posts: 9
Credit: 2276534
RAC: 0

archae86 wrote:In what I

archae86 wrote:
In what I assume is an outcome related to these changes, I noticed that BOINCStats today suddenly reports a big upgrade to my reported world position, world position based on RAC, and the corresponding rankings for individual machines.  I supposed BOINCStats either lacks access to or does not successfully use anonymized data it could use to provide correct rankings under the new scheme.

I think you misunderstand how this has been implemented. The users who have NOT checked the opt-in box no longer have their data in the xml at all. I personally wish it was just anonymized, but it's removed altogether, so for 3rd party stats it now only appears to be less than 3000 users...

 

Betreger
Betreger
Joined: 25 Feb 05
Posts: 992
Credit: 1592222351
RAC: 773918

Bok wrote:archae86 wrote:In

Bok wrote:
archae86 wrote:
In what I assume is an outcome related to these changes, I noticed that BOINCStats today suddenly reports a big upgrade to my reported world position, world position based on RAC, and the corresponding rankings for individual machines.  I supposed BOINCStats either lacks access to or does not successfully use anonymized data it could use to provide correct rankings under the new scheme.

I think you misunderstand how this has been implemented. The users who have NOT checked the opt-in box no longer have their data in the xml at all. I personally wish it was just anonymized, but it's removed altogether, so for 3rd party stats it now only appears to be less than 3000 users...

 

This renders half of the functionality of Boincstats gone.   

mmonnin
mmonnin
Joined: 29 May 16
Posts: 291
Credit: 3414266540
RAC: 3503246

One other thing is that the

One other thing is that the daily credit for the users on a team doesn't add up to the daily team credit since some users aren't being displayed.

Each day at E@H and LHC people get bumped back down in overall standings as people enable their export. Today everyone showed up on LHC at Free-DC

mikey
mikey
Joined: 22 Jan 05
Posts: 12693
Credit: 1839099724
RAC: 3697

Shawn Kwang wrote:Yes.You

Shawn Kwang wrote:

Yes.

You are seeing the effect of the new statistics export option and that we are now enforcing this within the stats. exports themselves. The behavior you are seeing is correct: that nusers_total reports the total number of users, but that the user.xml file only reports users who have consented to the stats. exports, which as you see is a much smaller number.

This configuration is the new setup going forward. The opt-in went into effect 17 December 2018.

Also: Moved this thread to Problems and Bug Reports.

BUT I checked the agree box days ago and just TODAY lost all my Einstein credits and account showing up on both Boinc Stats and FreeDC, seems to me the left hand isn't talking to the right hand somewhere.

Okay this MAY have been an error on my part, I just went into: view account, preferences, privacy and saw that the line saying "

Do you consent to exporting your data to BOINC statistics aggregation Web sites?:

yes

no

"

 

was still set to NO, I just changed that to YES and clicked SAVE Changes at the bottom of the page and hopefully my stats will be sent to the stats sites now.

Hopefully this links to your account and not mine so you can check yours:

https://einsteinathome.org/account/prefs/privacy

 

Richie
Richie
Joined: 7 Mar 14
Posts: 656
Credit: 1702989778
RAC: 0

mmonnin wrote:Today everyone

mmonnin wrote:
Today everyone showed up on LHC at Free-DC

I'm not sure if I've understood right but I believe after getting feedback and considering the situation LHC stopped from requiring to tick the box and changed the default setting to be other way around. So every user account would be included in stats export by default again.

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4901

Or is that yet implemented / gonna be implemented... still a bit unclear to me.

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1364
Credit: 3562358667
RAC: 0

Richie wrote:mmonnin

Richie wrote:
mmonnin wrote:
Today everyone showed up on LHC at Free-DC

I'm not sure if I've understood right but I believe after getting feedback and considering the situation LHC stopped from requiring to tick the box and changed the default setting to be other way around. So every user account would be included in stats export by default again.

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4901

Or is that yet implemented / gonna be implemented... still a bit unclear to me.

Go to the end of the thread.  They backed down after concluding that a retroactive stats blackout would be too disruptive.  And they apparently did so quickly enough to avoid creating a hole in the boinc stats historical data.  OTOH they also handled the initial rollout spectacularly badly; with no meaningful advance notice given; "FYI we're installing a new version of the server code" with no indication that anything other than a brief server outage during the upgrade will impact users is useless.

 

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4901&postid=37662#37662

mikey
mikey
Joined: 22 Jan 05
Posts: 12693
Credit: 1839099724
RAC: 3697

Richie wrote:mmonnin

Richie wrote:
mmonnin wrote:
Today everyone showed up on LHC at Free-DC

I'm not sure if I've understood right but I believe after getting feedback and considering the situation LHC stopped from requiring to tick the box and changed the default setting to be other way around. So every user account would be included in stats export by default again.

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4901

Or is that yet implemented / gonna be implemented... still a bit unclear to me.

I WISH all projects would do that, that way those concerned could say no and the rest of us who don't care aren't affected. I have no problem with people not wanting their stuff shown, some people have their pc's hidden, but I personally don't see the problem in showing stats or my pc's.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.