This issue appears to be caused by a missing font on the system (according to the test output).

Moving to infra to check the installed fonts on the system. It's happening on multiple slaves, but the messages are always the same. The Symbol font is missing, and it's falling back to 'sans' or 'dejavu sans'.

Example test output:

FontTest.GetActualFontNameForTesting (run #1):
[ RUN      ] FontTest.GetActualFontNameForTesting
../../ui/gfx/font_unittest.cc:148: Failure
Value of: base::ToLowerASCII(symbol.GetActualFontNameForTesting())
  Actual: "dejavu sans"
Expected: "symbol"
********
Your test environment seems to be missing Symbol font, which is needed for unittests.  Check if Symbol font is installed.
********
[  FAILED  ] FontTest.GetActualFontNameForTesting (3 ms)

 Issue 610787  has been merged into this issue.

 Issue 610786  has been merged into this issue.

 Issue 610785  has been merged into this issue.

 Issue 610783  has been merged into this issue.

This is also occurring on the Linux ASan bot:

https://uberchromegw.corp.google.com/i/chromium.memory/builders/Linux%20ASan%20LSan%20Tests%20%281%29/builds/26028

Detected 5 new flakes for test/step "FontListTest.Fonts_GetHeight_GetBaseline". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihGb250TGlzdFRlc3QuRm9udHNfR2V0SGVpZ2h0X0dldEJhc2VsaW5lDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 5 new flakes for test/step "FontTest.GetActualFontNameForTesting". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRGb250VGVzdC5HZXRBY3R1YWxGb250TmFtZUZvclRlc3RpbmcM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 5 new flakes for test/step "RenderTextTest.HarfBuzz_FontListFallback". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihSZW5kZXJUZXh0VGVzdC5IYXJmQnV6el9Gb250TGlzdEZhbGxiYWNrDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 5 new flakes for test/step "RenderTextTest.SetFontList". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpSZW5kZXJUZXh0VGVzdC5TZXRGb250TGlzdAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 5 new flakes for test/step "RenderTextTest.StringSizeRespectsFontListMetrics". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyOwsSBUZsYWtlIjBSZW5kZXJUZXh0VGVzdC5TdHJpbmdTaXplUmVzcGVjdHNGb250TGlzdE1ldHJpY3MM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "FontListTest.Fonts_GetHeight_GetBaseline". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihGb250TGlzdFRlc3QuRm9udHNfR2V0SGVpZ2h0X0dldEJhc2VsaW5lDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "FontTest.GetActualFontNameForTesting". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRGb250VGVzdC5HZXRBY3R1YWxGb250TmFtZUZvclRlc3RpbmcM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.HarfBuzz_FontListFallback". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihSZW5kZXJUZXh0VGVzdC5IYXJmQnV6el9Gb250TGlzdEZhbGxiYWNrDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.SetFontList". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpSZW5kZXJUZXh0VGVzdC5TZXRGb250TGlzdAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.StringSizeRespectsFontListMetrics". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyOwsSBUZsYWtlIjBSZW5kZXJUZXh0VGVzdC5TdHJpbmdTaXplUmVzcGVjdHNGb250TGlzdE1ldHJpY3MM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Assigning to msw@chromium.org for investigating.

Did the bots lose fonts recently? I'm not a good owner here... CC'ing some folks.

looks like some bots have wrong font config?

Detected 3 new flakes for test/step "FontListTest.Fonts_GetHeight_GetBaseline". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihGb250TGlzdFRlc3QuRm9udHNfR2V0SGVpZ2h0X0dldEJhc2VsaW5lDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "FontTest.GetActualFontNameForTesting". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRGb250VGVzdC5HZXRBY3R1YWxGb250TmFtZUZvclRlc3RpbmcM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.HarfBuzz_FontListFallback". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihSZW5kZXJUZXh0VGVzdC5IYXJmQnV6el9Gb250TGlzdEZhbGxiYWNrDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.SetFontList". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpSZW5kZXJUZXh0VGVzdC5TZXRGb250TGlzdAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.StringSizeRespectsFontListMetrics". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyOwsSBUZsYWtlIjBSZW5kZXJUZXh0VGVzdC5TdHJpbmdTaXplUmVzcGVjdHNGb250TGlzdE1ldHJpY3MM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "FontListTest.Fonts_GetHeight_GetBaseline". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihGb250TGlzdFRlc3QuRm9udHNfR2V0SGVpZ2h0X0dldEJhc2VsaW5lDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "FontTest.GetActualFontNameForTesting". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRGb250VGVzdC5HZXRBY3R1YWxGb250TmFtZUZvclRlc3RpbmcM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.HarfBuzz_FontListFallback". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihSZW5kZXJUZXh0VGVzdC5IYXJmQnV6el9Gb250TGlzdEZhbGxiYWNrDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.SetFontList". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpSZW5kZXJUZXh0VGVzdC5TZXRGb250TGlzdAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.StringSizeRespectsFontListMetrics". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyOwsSBUZsYWtlIjBSZW5kZXJUZXh0VGVzdC5TdHJpbmdTaXplUmVzcGVjdHNGb250TGlzdE1ldHJpY3MM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

derat@ once fixed the similar issue as
https://codereview.chromium.org/72713004

derat@, could you take a look?

Sorry, I don't know anything about bot configs (and don't work on Chrome beyond 20% time now).

Looking closer at one of the failures:  https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_rel_ng/builds/229936/steps/gfx_unittests%20%28with%20patch%29%20on%20Ubuntu-12.04/logs/stdio

The respective swarming task is  
https://chromium-swarm.appspot.com/user/task/2ed51f781078a910  

which was run on https://chromium-swarm.appspot.com/restricted/bot/gce-precise-45039ac7-5d9c

Which is a mp based gce slave.   +smut@ who is the mp person.

Machine Provider is using chrome-precise-16050300-5fbe1d8e490, whereas the rest of our ccompute images are at chrome-precise-16030700-239f9da2248. Is the Symbol font missing from the MP image?

Detected 3 new flakes for test/step "FontListTest.Fonts_GetHeight_GetBaseline". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihGb250TGlzdFRlc3QuRm9udHNfR2V0SGVpZ2h0X0dldEJhc2VsaW5lDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "FontTest.GetActualFontNameForTesting". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRGb250VGVzdC5HZXRBY3R1YWxGb250TmFtZUZvclRlc3RpbmcM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.HarfBuzz_FontListFallback". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMwsSBUZsYWtlIihSZW5kZXJUZXh0VGVzdC5IYXJmQnV6el9Gb250TGlzdEZhbGxiYWNrDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.SetFontList". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpSZW5kZXJUZXh0VGVzdC5TZXRGb250TGlzdAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Detected 3 new flakes for test/step "RenderTextTest.StringSizeRespectsFontListMetrics". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyOwsSBUZsYWtlIjBSZW5kZXJUZXh0VGVzdC5TdHJpbmdTaXplUmVzcGVjdHNGb250TGlzdE1ldHJpY3MM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Judging by the history of this bug, it seems that Infra is better suited at looking into this.

The best hypothesis we have is that machine-provider bots have different fonts than standard bots. Sana, please figure out if this is the case. If it is, please fix. If not, please reassign or return to the trooper queue with an update.

swarm1-c4:~$ fc-list | grep Symbol
Symbol:style=Regular

gce-precise-dev-45039ac7-la2i:~$ fc-list | grep Symbol


The Symbol font is indeed missing on MP VMs. Not sure why Symbol is missing from chrome-precise-16050300-5fbe1d8e490 but present on chrome-precise-16030700-239f9da2248.

Assigning to Vadim who generated the most recent MP image.

tl;dr xfonts-mathml was removed from install-build-deps.sh for some reason.

Longer version:

I suspect fonts are installed by install-build-deps.sh. 

chrome-precise-16030700-239f9da2248 was built using https://chromium.googlesource.com/chromium/src/+/dd26069ac26c43fcb8628e61eb6d45cc1f696f01/build/install-build-deps.sh

chrome-precise-16050300-5fbe1d8e490 was built using https://chromium.googlesource.com/chromium/src/+/fb7d585988b1974b13bf7b1eb0fa9b9d3861d92f/build/install-build-deps.sh

One crucial change is this commit: https://chromium.googlesource.com/chromium/src/+/3e728c40b36cb9ea3c6bd12fc272f145fb2bb06e

It makes newer image to have "fonts-stix" package installed instead of "xfonts-mathml".

I believe xfonts-mathml is where "Symbol" font is located. And "fonts-stix" doesn't have it.

I don't know why it was done... I'll add it back (along with fonts-stix, if it is needed).

Hmm. Yes, xfonts-mathml was installed for the Symbol font, not for any MathML-related needs. Looks like it's not present in Ubuntu 15.10. (http://packages.ubuntu.com/search?keywords=xfonts-mathml). I wonder if something like fonts-opensymbol (http://packages.ubuntu.com/search?keywords=fonts-opensymbol) would be a usable alternative.

I attempt just to fix Precise for now with this CL: https://codereview.chromium.org/1998443002/

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/278ff066e18d726f7273263c6e2b9c71a7722397

commit 278ff066e18d726f7273263c6e2b9c71a7722397
Author: vadimsh <vadimsh@chromium.org>
Date: Thu May 19 00:06:28 2016

Always install xfonts-mathml package if it is available.

It contains "Symbol" font used by gfx_unittests.

The package was effectively removed from install-build-deps in
https://codereview.chromium.org/1580663002. Looks like it doesn't exist in
Ubuntu 15.10. So use 'package_exists' check before attempting to install it.

R=dpranke@chromium.org
BUG= 610784 

Review-Url: https://codereview.chromium.org/1998443002
Cr-Commit-Position: refs/heads/master@{#394611}

[modify] https://crrev.com/278ff066e18d726f7273263c6e2b9c71a7722397/build/experimental/install-build-deps.py
[modify] https://crrev.com/278ff066e18d726f7273263c6e2b9c71a7722397/build/install-build-deps.sh

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/db91d5547c69a02d886d4e79ed25df1ffb282c1b

commit db91d5547c69a02d886d4e79ed25df1ffb282c1b
Author: vadimsh <vadimsh@google.com>
Date: Thu May 19 00:56:56 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config.git/+/2940e4afbd19c6909e60153bfd2312658253fd18

commit 2940e4afbd19c6909e60153bfd2312658253fd18
Author: Vadim Shtayura <vadimsh@chromium.org>
Date: Thu May 19 01:52:19 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/ff698df15947b4404fac580ec636ea271de12593

commit ff698df15947b4404fac580ec636ea271de12593
Author: vadimsh <vadimsh@google.com>
Date: Thu May 19 01:52:25 2016

New image has been deployed to MP bots, I think this is resolved now.