Broadband Quality of Service Experience (QoSE)

Broadband Quality of Service Experience (QoSE): How does PH Internet Fare? Mary Grace Mirandilla-Santos Independent telecom/ICT policy researcher June 27, 2014 | DOST-ICTO

Broadband QoSE • LIRNEasia: a regional ICT and policy regulation think tank active across Asia Pacific. • AsokaTissa (AT) Tester: user-oriented diagnostic methodology designed to test different parameters of quality that affect a user’s online experience. • Software based; more cost effective; multiple domains; multiple readings

• Web-based and free:

http://www.lirneasia.net/AT_Tester

AT-Tester Method 1. 6 Parameters: Download, Upload, RTT, Jitter, Packet Loss and Availability 2. Multiple days: during the week and on weekends 3. At six times: 0800, 1100, 1500, 1800, 2000, 2300 hrs (3 readings per slot) 4. Averages of multiple readings for each time slot, taken from unannounced, unknown locations 5. Varying server locations: ISP domain; International domain; National domain Participants: select South Asian and Southeast Asian cities , including Manila.

Parameters Tested • Throughput (Kbps) – actual amount of useful data sent on a transmission; – download or upload speeds to/from a local and int’l server. • Latency (ms) – delays when voice packets transverse the network, measured in milliseconds by using Round Trip Time (RTT); – less than 300 ms is considered acceptable. • Jitter (ms) – uneven latency and packet loss – less than 50ms is acceptable. • Packet Loss (%) – number of packets that does not reach destination. – less than 3% is considered good.

Source: Gonsalves, T.A. & Bharadwaj, A. (2009)

Actual vs. Advertised Speed Download from an international server 120 110

Advertised "Up to" Speed

Actual vs Advertised (%)

100 90 80 70 60 50 40 30 20 10 0 0800 H

1100 H

1500 H

1800 H

2000 H

SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo Prepaid Stick (3.6 Mbps)-Manila,PH* Sun Broadband Plan 799 (3.6Mbps)-Manila,PH

2300 H

Actual vs. Advertised Speed Download from an international server

35

31.8% 30

Actual vs. Advertised (%)

INDONESIA (3.6 mbps) 25 20

21.7%

15

PHILIPPINES (3.6 mbps)

10 5 0 0800 H

1100 H

1500 H

1800 H

2000 H

Telkomsel Flash Ultima(3.6Mbps)-Jakarta,ID SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo Prepaid Stick (3.6 Mbps)-Manila,PH* Sun Broadband Plan 799 (3.6Mbps)-Manila,PH

2300 H

Actual vs. Advertised Speed Download from an international server

30

NEPAL (7.2 mbps)

Actual vs Advertised (%)

25

20 15

10 PHILIPPINES (7.2 mbps)

5 0 0800 H

1100 H

1500 H

1800 H

2000 H

Ncell (7.2Mbps)-Kathmandu,NP* SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo Prepaid Stick (3.6 Mbps)-Manila,PH* Sun Broadband Plan 799 (3.6Mbps)-Manila,PH

2300 H

Latency - International Philippine ISPs Only

700

600

Latency (RTT)

500

503 ms

438 ms

437.6 ms

400 300

Lower the better 300ms

200 100 0 0800 H

1100 H

1500 H

1800 H

2000 H

SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo Prepaid Stick (3.6 Mbps)-Manila,PH* Sun Broadband Plan 799 (3.6Mbps)-Manila,PH

2300 H

Jitter - International Philippine ISPs Only

350

300

291.8 ms 250

Jitter (ms)

200

228.6 ms 188.5 ms

150 100 50

Lower the better 50ms

0 0800 H

1100 H

1500 H

1800 H

2000 H

SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo Prepaid Stick (3.6 Mbps)-Manila,PH* Sun Broadband Plan 799 (3.6Mbps)-Manila,PH

2300 H

Value for Money (kbps per USD) Philippine ISPs Only

50 45 40 35

kbps per USD

30

25 20 15 10 5 0 0800 H

1100 H

1500 H

1800 H

2000 H

SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo 4G Flash(7.2 Mbps)-Manila,PH* Sun Broadband Plan 799 (3.6Mbps)-Manila,PH

2300 H

Value for Money Download speed (average of 4 days/time slot) Monthly Cost of Plan (USD)*

If you pay PHP800/month for speeds of “up to 3.6 Mbps” but your actual average speed is 500 kbps, then you get only 14% of what you pay for (based on advertised speed). * For prepaid, the “unli data promo” cost for 5 days was used x 6 to get the price for 30 days or 1 month.

Value for Money (kbps per USD) Philippine vs. select SA & SEA ISPs

300

Airtel 3G (4Mbps)-Bangalore,IN Tata (3.1Mbps)-Chennai,LK

250

Airtel (4Mbps)-Delhi,IN Airtel LTE (4Mbps)-Bangalore,IN

kbps per USD

200

Ooredoo Data 99 (7Mbps)-Male,MV Dhiraagu Data 200 (1Mbps)-Male,MV

150

Ncell (7.2Mbps)-Kathmandu,NP PTCL Evo (9.3Mbps)-Karachi,PK Etisalat (7.2Mbps)-Colombo,LK

100

Telkomsel Flash Ultima(3.6Mbps)Jakarta,ID

50

0 0800 H

1100 H

1500 H

1800 H

2000 H

2300 H

SMART Bro Starter Plug-it (7.2 Mbps)-Manila,PH* Globe Tattoo 4G Flash(7.2 Mbps)Manila,PH* Sun Broadband Plan 799 (3.6Mbps)Manila,PH

Important Questions • Is there truth in advertising? 21.7% highest actual vs. advertised speed achieved. Recommended is 80% for PH.

• Are Philippine ISPs offering broadband? (Relatively) better performing PH plan tested offered >256 kbps download speed only 50% of the time.

• Must government rule on minimum performance standards for internet service? All three major ISPs did not meet acceptable levels for critical QoSE parameters (actual vs advertised, latency, jitter) and has lowest value for money among all ISPs tested.

Thank you. Mary Grace Mirandilla-Santos Independent telecom/ICT policy researcher gmirandilla at gmail dot com http://www.linkedin.com/in/gracemirandilla