‘Avoid Biased Calculations’ Says Crypto Researcher After Cherry-Picked Chart Debate

On Friday, crypto analytics site Messari and data analyst Zack Voell shared a controversial chart called “Bitcoin Cash versus Lightning,” which claims to display a comparison of activity for both networks. Voell contended that the Lightning Network was growing at a faster rate than the scaling solution BCH has to offer. The way the chart was portrayed and the written critique was contentious, to say the least, and crypto supporters accused the Messari analyst of being biased and “cherry picking” data.

Also Read: Bitcoin’s Early Days: How Crypto’s Past Is Much Different Than the Present

Messari Analyst Accused of Cherry Picking Data

Zack Voell, a data analyst from Messari, stands accused of producing biased material for the website that claims to “promote transparency and smarter decision-making in the cryptoasset community.” On Sep. 6, Voell tweeted a chart that claimed to show the comparative growth and use of BCH versus the Lightning Network. A quick glimpse at the chart shared by Voell makes it look like the Lightning Network has seen exponential growth while the BCH side is dreary. According to the author, “[BCH] transaction count, traded volume, returns (denominated in Bitcoin), and active addresses all fell by double-digit percentages since September 2018.”

Bitcoin Cash versus Lightning

YTD of comparative network activity seems to show one scaling solution growing significantly faster than the other. (Obviously, the comparison is imperfect, but these data are still telling.) https://t.co/Uvf5z2WoBW pic.twitter.com/qzjFdYkPSC

— Peter Ryan (@_PeterRyan) September 7, 2019

Following Voell’s tweet, live stream host Collin Enstad laughed at the Messari analyst’s chart and asked: “Did you just cherry pick a stress test day from a year ago and then claim the transaction count is down over 90% — 12 months later?” During the first week of September 2018, BCH participants had multiple stress tests and the network saw millions of transactions per day on a few occasions that week. In fact, many BCH supporters believe the September stress tests proved that Bitcoin can scale, when miners processed 2.4 million transactions in one day and fees remained at $0.003-0.001 per transaction.

‘Avoid Biased Calculations’ Says Crypto Researcher After Cherry-Picked Chart Debate

In response to Voell’s tweet and chart, the researcher from Ryan Research, Peter Ryan, asked the Messari analyst why he didn’t use year-to-date (YTD). Ryan further explained that looking at the comparative growth and use of Bitcoin Cash versus Lightning is better with YTD metrics. “YTD of comparative network activity seems to show one scaling solution growing significantly faster than the other. (Obviously, the comparison is imperfect, but these data are still telling),” Ryan’s tweet said. Following the discussion on Twitter, news.Bitcoin.com spoke with Peter Ryan about Voell’s assessment of both networks.

A Discussion With Researcher Peter Ryan

News.Bitcoin.com (BC): What do you think about the recent chart Zack Voell from Messari shared yesterday?

Peter Ryan (PR): While it appeared to use valid data, the comparison was dubious in a few ways.

One, BCH and the Lightning Network (LN) are two different technologies with different metrics. This is a classic apples to oranges fallacy. For instance, there’s no way to measure the transaction count on the LN and no equivalent of “node capacity” on BCH.

Two, the choice of data was biased. It showed 12 months back to a stress test on the BCH network which could distort how one could view growth. This is why most analysis comes out quarterly or monthly because it provides an objective choice of dates rather than one that is arbitrary.

‘Avoid Biased Calculations’ Says Crypto Researcher After Cherry-Picked Chart DebatePeter Ryan, founder of Ryan Research.

BC: Why do you think someone from a startup that’s supposed to share unbiased data concerning crypto networks and markets would share something like that?

I’m sure he would paint it as “just reporting the data,” but this is obviously a low-brow attempt to justify the fragile scaling narrative around the Lightning Network.

BC: Do you think the chart and report reflected poorly on Messari?

PR: Yes. It’s a shame that their tools for better data analysis get overshadowed by their team’s repeated demonstrations of bias. It’s possible that this bias could taint their quantitative reporting, although that hopefully seems unlikely. I’m more concerned about them leveraging the brand of an objective data provider to perform distorted punditry.

BC: You recently shared a chart of your own from Ryan Research can you tell us about the data stemming from this?

PR: It was more a lark than a chart. I was displeased with the sleight of hand by Zack, so I duplicated the exact same chart as his but changed only one parameter: the date.

My chart compared YTD instead of his 12-month version and showed a different picture. Bitcoin Cash actually performed better than Lightning. For instance, BCH’s transactions grew 691% compared to much lower growth figures…

Article Source…