benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.browse:news:flipboard is flaky on Windows |
|||||||
Issue descriptionhttps://chromium-swarm.appspot.com/user/task/3242c0caf2b38110 [1/1] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.browse:news:flipboard failed unexpectedly 13.9880s: [ RUN ] browse:news:flipboard Traceback (most recent call last): File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\story_runner.py", line 87, in _RunStoryAndProcessErrorIfNeeded state.RunStory(results) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\page\shared_page_state.py", line 299, in RunStory self._current_page.Run(self) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\page\__init__.py", line 109, in Run self.RunPageInteractions(action_runner) File "e:\b\swarm_slave\w\irs2i8ls\tools\perf\core\path_util.pyc\..\..\page_sets\system_health\system_health_story.py", line 112, in RunPageInteractions self._DidLoadDocument(action_runner) File "e:\b\swarm_slave\w\irs2i8ls\tools\perf\page_sets\system_health\browsing_stories.py", line 71, in _DidLoadDocument self._NavigateToItem(action_runner, i) File "e:\b\swarm_slave\w\irs2i8ls\tools\perf\page_sets\system_health\browsing_stories.py", line 33, in _NavigateToItem action_runner.ScrollPageToElement(element_function=item_selector) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\actions\action_runner.py", line 429, in ScrollPageToElement speed_in_pixels_per_second=speed_in_pixels_per_second)) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\actions\action_runner.py", line 54, in _RunAction action.WillRunAction(self._tab) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\actions\scroll_to_element.py", line 54, in WillRunAction self._distance = tab.EvaluateJavaScript(get_distance_js) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\browser\web_contents.py", line 193, in EvaluateJavaScript expr, context_id=None, timeout=timeout) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\browser\web_contents.py", line 221, in EvaluateJavaScriptInContext expr, context_id=context_id, timeout=timeout) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function return func(*args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py", line 36, in inner return func(inspector_backend, *args, **kwargs) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py", line 211, in EvaluateJavaScript return self._runtime.Evaluate(expr, context_id, timeout) File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_runtime.py", line 53, in Evaluate raise exceptions.EvaluateException(text) EvaluateException: Uncaught [ FAILED ] browse:news:flipboard (11316 ms) [ PASSED ] 0 tests. [ FAILED ] 1 test, listed below: [ FAILED ] browse:news:flipboard 1 FAILED TEST View result at file://e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\testing\results.html Chrome build location for win_AMD64 not found. Browser will be run without Flash. Chrome build location for win_AMD64 not found. Browser will be run without Flash. Chrome build location for win_AMD64 not found. Browser will be run without Flash. Chrome build location for win_AMD64 not found. Browser will be run without Flash. Tsproxy commandline: ['e:\\b\\depot_tools\\python276_bin\\python.exe', 'e:\\b\\swarm_slave\\w\\irs2i8ls\\third_party\\catapult\\telemetry\\third_party\\tsproxy\\tsproxy.py', '--port=0', '--desthost=127.0.0.1'] TsProxy port: 61757 Trace config file string: {"trace_config": {"excluded_categories": ["*"], "included_categories": ["blink.console", "disabled-by-default-memory-infra"], "record_mode": "record-as-much-as-possible"}} Starting Web-Page-Replay: ['e:\\b\\depot_tools\\python276_bin\\python.exe', 'e:\\b\\swarm_slave\\w\\irs2i8ls\\third_party\\catapult\\telemetry\\third_party\\web-page-replay\\replay.py', '--host=127.0.0.1', '--port=0', '--ssl_port=0', '--no-dns_forwarding', '--use_closest_match', '--log_level=info', u'e:\\b\\swarm_slave\\w\\irs2i8ls\\tools\\perf\\page_sets\\data\\system_health_desktop_021.wpr'] WPR ports: {} WPR ports: {} WPR ports: {} WPR ports: {} WPR ports: {} WPR ports: {} WPR ports: {} WPR ports: {} WPR ports: {'http': 61759, 'https': 61760} Issuing command to ts_proxy_server: set mapports 443:61760,*:61759 Requested remote debugging port: 0 Chrome log file will be saved in e:\b\swarm_slave\w\itr16eor\tmpmkdltc\chrome.log Starting Chrome ['e:\\b\\swarm_slave\\w\\irs2i8ls\\out\\Release_x64\\chrome.exe', u'--force-fieldtrials=AutofillClassifier/Enabled/AutofillCreditCardSigninPromo/EnabledFive/AutofillFieldMetadata/Enabled/AutofillProfileCleanup/Enabled/AutofillProfileOrderByFrecency/EnabledLimitTo3/AutomaticTabDiscarding/Enabled_Once_10-gen2/BrowserBlacklist/Enabled/BrowserScheduler/Enabled/CSSExternalScanner/Enabled_ScanAndPreload/CaptivePortalInterstitial/Enabled/ChildAccountDetection/Disabled/ChromeDashboard/Enabled/ChromotingQUIC/Enabled/DataReductionProxyUseQuic/Enabled/DefaultBrowserInfobar/SettingsTextNotNow/DefaultEnableGpuRasterization/DefaultEnableGpuRasterization/DisallowFetchForDocWrittenScriptsInMainFrame/DocumentWriteScriptBlockGroup/EnableAppContainer/Enabled/EnableGoogleCachedCopyTextExperiment/Button/EnableMediaRouter/Enabled/EnableMediaRouterWithCastExtension/Enabled/EnableSessionCrashedBubbleUI/Enabled/ExpectCTReporting/ExpectCTReportingEnabled/ExtensionActionRedesign/Enabled/ExtensionContentVerification/Enforce/ExtensionInstallVerification/Enforce/GoogleBrandedContextMenu/branded/GoogleNow/Enable/IconNTP/Default/InstanceID/Enabled/IntelligentSessionRestore/Enabled/MaterialDesignDownloads/Enabled/MaterialDesignUserManager/Enabled/MediaFoundationH264Encoding/Enabled/MojoChannel/Enabled/NetDelayableH2AndQuicRequests/Enabled/NetworkQualityEstimator/Enabled/NetworkTimeQueries/NetworkTimeQueriesEnabled/NewAudioRenderingMixingStrategy/Enabled/NewProfileManagement/Enabled/NonValidatingReloadOnNormalReload/Enabled/OfferUploadCreditCards/Enabled/OutOfProcessPac/Enabled/PageRevisitInstrumentation/Enabled/ParseHTMLOnMainThread/Enabled/PassiveDocumentEventListeners/Enabled/PassiveEventListenersDueToFling/Enabled/PasswordBranding/SmartLockBrandingSavePromptOnly/PasswordGeneration/Disabled/PasswordManagerSettingsMigration/Enable/PasswordSeparatedSigninFlow/Enabled/PasswordSmartBubble/3-Times/PersistentHistograms/EnabledInMemory/PointerEvent/Enabled/PreconnectMore/Enabled/PreferHtmlOverPlugins/Enabled/PrintScaling/Enabled/QUIC/Enabled/RafAlignedMouseInput/Enabled/RafAlignedTouchInput/Enabled/RefreshTokenDeviceId/Enabled/ReportCertificateErrors/ShowAndPossiblySend/SRTPromptFieldTrial/On/SSLCommonNameMismatchHandling/Enabled/SafeBrowsingIncidentReportingService/Enabled/SafeBrowsingIncidentReportingServiceFeatures/WithSuspiciousModuleReporting/SafeBrowsingReportPhishingErrorLink/Enabled/SafeBrowsingUpdateFrequency/UpdateTime15m/SafeBrowsingV4LocalDatabaseManagerEnabled/Enabled/SaveAsMenuText/download/SchedulerExpensiveTaskBlocking/Enabled/SdchPersistence/Enabled/SecurityChip/Enabled/SecurityWarningIconUpdate/Enabled/SettingsEnforcement/enforce_always_with_extensions_and_dse/SignInPasswordPromo/Enable3/SiteEngagement/AggressiveAccumulation/SpeculativeLaunchServiceWorker/Enabled/StrictSecureCookies/Enabled/SyncHttpContentCompression/Enabled/TLS13Negotiation/Enabled/TabSyncByRecency/Enabled/TokenBinding/TokenBinding/TranslateRanker/EnforcementEnabled/TriggeredResetFieldTrial/On/V8CacheStrategiesForCacheStorage/default/WebBluetoothBlacklist/TestGroup/WebFontsInterventionV2/Enabled-slow2g/WebRTC-EnableWebRtcEcdsa/Enabled/WebRTC-H264WithOpenH264FFmpeg/Enabled/WebRTC-LocalIPPermissionCheck/Enabled/use-new-media-cache/Enabled', u'--force-fieldtrial-params=AutofillCreditCardSigninPromo.EnabledFive:impression_limit/5,AutofillProfileOrderByFrecency.EnabledLimitTo3:limit/3,AutomaticTabDiscarding.Enabled_Once_10-gen2:MinimumProtectionTime/600,BrowserScheduler.Enabled:Background/3;8;0%2E1;0;30000/BackgroundFileIO/3;8;0%2E1;0;30000/Foreground/8;32;0%2E3;0;30000/ForegroundFileIO/8;32;0%2E3;0;30000/RedirectSequencedWorkerPools/true,CSSExternalScanner.Enabled_ScanAndPreload:cssExternalScannerNoPreload/false/cssExternalScannerPreload/true,DisallowFetchForDocWrittenScriptsInMainFrame.DocumentWriteScriptBlockGroup:disallowFetchForDocWrittenScriptsInMainFrameOnSlowConnections/true,NetworkQualityEstimator.Enabled:2G%2EDefaultMedianKbps/81/2G%2EDefaultMedianRTTMsec/1337/3G%2EDefaultMedianKbps/658/3G%2EDefaultMedianRTTMsec/297/4G%2EDefaultMedianKbps/1756/4G%2EDefaultMedianRTTMsec/159/Bluetooth%2EDefaultMedianKbps/449/Bluetooth%2EDefaultMedianRTTMsec/135/Ethernet%2EDefaultMedianKbps/3263/Ethernet%2EDefaultMedianRTTMsec/106/HalfLifeSeconds/60/None%2EDefaultMedianKbps/567/None%2EDefaultMedianRTTMsec/272/Slow2G%2EThresholdMedianHttpRTTMsec/2000/Unknown%2EDefaultMedianKbps/1916/Unknown%2EDefaultMedianRTTMsec/121/WiFi%2EDefaultMedianKbps/2736/WiFi%2EDefaultMedianRTTMsec/168/correlation_logging_probability/0%2E001,ParseHTMLOnMainThread.Enabled:parseHTMLOnMainThreadCoalesceChunks/false/parseHTMLOnMainThreadSyncTokenize/false,PasswordSmartBubble.3-Times:dismissal_count/3,PersistentHistograms.EnabledInMemory:storage/LocalMemory,ReportCertificateErrors.ShowAndPossiblySend:sendingThreshold/1%2E0,SafeBrowsingIncidentReportingService.Enabled:collect_reg_data/true,SafeBrowsingUpdateFrequency.UpdateTime15m:NextUpdateIntervalInMinutes/15,SecurityChip.Enabled:animation/animate-all/visibility/show-all,SignInPasswordPromo.Enable3:dismissal_threshold/3,SiteEngagement.AggressiveAccumulation:bootstrap_points/24/decay_period_in_hours/2/decay_points/0/decay_proportion/0%2E984/first_daily_engagement_points/1%2E5/hidden_media_playing_points/0%2E01/high_engagement_boundary/50/last_engagement_grace_period_in_hours/1/max_decays_per_score/4/max_points_per_day/15/medium_engagement_boundary/15/navigation_points/1%2E5/score_cleanup_threshold/0%2E5/user_input_points/0%2E6/visible_media_playing_points/0%2E06/web_app_installed_points/5,WebBluetoothBlacklist.TestGroup:blacklist_additions/00060000%3Ae%2Cfffd%3Ae%2Ced5f25a4%3Ae', u'--enable-features=AutofillCreditCardSigninPromo,AutofillProfileCleanup,AutomaticTabDiscarding,DefaultEnableGpuRasterization,ExpectCTReporting,MaterialDesignUserManager,MediaFoundationH264Encoding,PrioritySupportedRequestsDelayable,NetworkTimeServiceQuerying,NewAudioRenderingMixingStrategy,NonValidatingReloadOnNormalReload,ParseHTMLOnMainThread,PassiveDocumentEventListeners,PassiveEventListenersDueToFling,UsePasswordSeparatedSigninFlow,PersistentHistograms,PointerEvent,PreconnectMore,PreferHtmlOverPlugins,PrintScaling,RafAlignedMouseInput,RafAlignedTouchInput,IncidentReportingDisableUpload,IncidentReportingModuleLoadAnalysis,IncidentReportingSuspiciousModuleReporting,SecurityChip,SecurityWarningIconUpdate,SpeculativeLaunchServiceWorker,NegotiateTLS13,token-binding,TranslateRankerEnforcement,WebRTC-EnableWebRtcEcdsa,WebRTC-H264WithOpenH264FFmpeg,use-new-media-cache', u'--disable-features=DocumentWriteEvaluator', '--enable-memory-benchmarking', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--disable-background-networking', '--proxy-server=socks://localhost:61757', '--ignore-certificate-errors', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--enable-logging', '--v=0', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--window-size=1280,1024', '--user-data-dir=e:\\b\\swarm_slave\\w\\itr16eor\\tmpgwhs1j', '--trace-config-file=e:\\b\\swarm_slave\\w\\itr16eor\\tmpif1ygv\\chrome-trace-config.json', 'about:blank'] Discovered ephemeral port 61762 OS: win win7 GPU device 0: VENDOR = 0x15ad, DEVICE = 0x405 GPU Attributes: adapter_luid : 0.0 amd_switchable : False basic_info_state : 1 context_info_state : 3 direct_rendering : True driver_date : 11-11-2013 driver_vendor : VMware, Inc. driver_version : 7.14.1.2032 dx_diagnostics_info_state: 3 gl_extensions : gl_renderer : gl_reset_notification_strategy: 0 gl_vendor : gl_version : gl_ws_extensions : gl_ws_vendor : gl_ws_version : in_process_gpu : True initialization_time : 0.0 jpeg_decode_accelerator_supported: False lenovo_dcute : False max_msaa_samples : optimus : False pixel_shader_version: process_crash_count : 1 sandboxed : False software_rendering : False vertex_shader_version: video_decode_accelerator_flags: 0 Feature Status: 2d_canvas : unavailable_software flash_3d : unavailable_software flash_stage3d : unavailable_software flash_stage3d_baseline: unavailable_software gpu_compositing : unavailable_software multiple_raster_threads: unavailable_off native_gpu_memory_buffers: disabled_software rasterization : unavailable_software video_decode : unavailable_software video_encode : unavailable_software vpx_decode : unavailable_software webgl : unavailable_off webgl2 : disabled_off Driver Bug Workarounds: clear_uniforms_before_first_program_use disable_direct_composition disable_discard_framebuffer disable_dxgi_zero_copy_video disable_framebuffer_cmaa exit_on_context_lost scalarize_vec_and_mat_constructor_args Issuing command to ts_proxy_server: set rtt 0 Issuing command to ts_proxy_server: set inkbps 0 Issuing command to ts_proxy_server: set outkbps 0 PageCacheTemperature: any *************** BROWSER STANDARD OUTPUT *************** *********** END OF BROWSER STANDARD OUTPUT ************ ********************* BROWSER LOG ********************* [3516:4028:1103/042802:ERROR:memory_mapped_file.cc(52)] Couldn't open e:\b\swarm_slave\w\irs2i8ls\out\Release_x64\chrome_200_percent.pak [3516:4028:1103/042802:ERROR:data_pack.cc(79)] Failed to mmap datapack [3516:4028:1103/042802:WARNING:chrome_browser_main_win.cc(419)] Command line too long for RegisterApplicationRestart [5560:5856:1103/042802:ERROR:angle_platform_impl.cc(33)] ANGLE Display::initialize error 4: Could not create D3D11 device. [5560:5856:1103/042802:ERROR:gl_surface_egl.cc(630)] eglInitialize D3D11 failed with error EGL_NOT_INITIALIZED, trying next display type [5560:5856:1103/042802:ERROR:angle_platform_impl.cc(33)] ANGLE Display::initialize error 4: Renderer does not support PS 3.0.aborting! [5560:5856:1103/042802:ERROR:gl_surface_egl.cc(630)] eglInitialize D3D9 failed with error EGL_NOT_INITIALIZED [5560:5856:1103/042802:ERROR:gl_initializer_win.cc(272)] GLSurfaceEGL::InitializeOneOff failed. [5560:5856:1103/042802:INFO:media_foundation_video_encode_accelerator_win.cc(290)] Windows versions earlier than 8 are not supported. [5560:5856:1103/042802:ERROR:gpu_child_thread.cc(328)] Exiting GPU process due to errors during initialization [3516:5748:1103/042802:ERROR:browser_gpu_channel_host_factory.cc(113)] Failed to launch GPU process. [3516:4028:1103/042805:INFO:CONSOLE(0)] "Uncaught (in promise) Existing credentials not found", source: https://flipboard.com/explore (0) ***************** END OF BROWSER LOG ****************** Chrome version: 2909 Error when deleting e:\b\swarm_slave\w\itr16eor\tmpp77yjv, will try again at exit. Traceback (most recent call last): File "e:\b\swarm_slave\w\irs2i8ls\third_party\catapult\telemetry\telemetry\internal\platform\tracing_controller_backend.py", line 275, in CollectAgentTraceData os.remove(self._trace_log) WindowsError: [Error 32] The process cannot access the file because it is being used by another process: 'e:\\b\\swarm_slave\\w\\itr16eor\\tmpp77yjv' Uploading e:\b\swarm_slave\w\itr16eor\tmpmkdltc\chrome.log to gs://chrome-telemetry-output/log_3e63d4cf-3d44-4637-99c5-ae6f86b76491 Uploading browser log to https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/log_3e63d4cf-3d44-4637-99c5-ae6f86b76491 Successfully shut down browser cooperatively Traceback (most recent call last): File "e:\b\swarm_slave\w\irs2i8ls\tools\perf\benchmarks\system_health_smoke_test.py", line 96, in RunTest msg='Failed: %s' % benchmark_class) AssertionError: Failed: <class 'benchmarks.system_health.DesktopMemorySystemHealth'> 27 tests run in 147.2s, 1 failure. Sadly we din't get the crash stack because EvaluateException is not of type AppCrashException. We probably should fix this. +Ken because "ANGLE Display::initialize " in the log. Do you think this is relevant to the crash?
,
Nov 3 2016
,
Nov 3 2016
,
Nov 3 2016
+Jamie and Geoff from the ANGLE team That's expected in my opinion -- these tests run on VMs which don't have GPUs, so the GPU process shouldn't be able to launch. However, I would expect that to be the case for all the tests, and to not have an effect on these smoke tests. Do you see the same error for the other tests?
,
Nov 3 2016
Can confirm the errors above would be expected on a VM without hardware D3D support. Aside: We can initialize with a WARP device but that's a different issue I would think.
,
Nov 3 2016
Disabling this in https://codereview.chromium.org/2479653002/
,
Nov 3 2016
,
Nov 3 2016
I'm pretty sure that more than just this test are flaking on Windows; have you checked some of the Windows runs from chromium-try-flakes indicated on Issue 637904 ? https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMAsSBUZsYWtlIiV0ZWxlbWV0cnlfcGVyZl91bml0dGVzdHMgKHdpdGggcGF0Y2gpDA
,
Nov 3 2016
Ken: I spot check 20 failed tests & all of them are due to this test.
,
Nov 3 2016
OK, thanks for checking.
,
Nov 4 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/aa018525f649335721cea7820dcbae8f0ac43ecc commit aa018525f649335721cea7820dcbae8f0ac43ecc Author: nednguyen <nednguyen@google.com> Date: Fri Nov 04 04:53:59 2016 [tools/perf] Disable smoke testing over memory_desktop.browse:news:flipboard due to flakiness BUG= 662021 Review-Url: https://codereview.chromium.org/2479653002 Cr-Commit-Position: refs/heads/master@{#429784} [modify] https://crrev.com/aa018525f649335721cea7820dcbae8f0ac43ecc/tools/perf/benchmarks/system_health_smoke_test.py
,
Dec 29 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/889401456c5adbcb91f996f55b619413241a57d4 commit 889401456c5adbcb91f996f55b619413241a57d4 Author: nednguyen <nednguyen@google.com> Date: Thu Dec 29 18:41:54 2016 Reenable Flipboard story on Mac BUG= 662021 , 663025 TBR=perejzu@chromium.org Review-Url: https://codereview.chromium.org/2602073002 Cr-Commit-Position: refs/heads/master@{#440974} [modify] https://crrev.com/889401456c5adbcb91f996f55b619413241a57d4/tools/perf/benchmarks/system_health_smoke_test.py [modify] https://crrev.com/889401456c5adbcb91f996f55b619413241a57d4/tools/perf/page_sets/system_health/browsing_stories.py
,
May 9 2017
|
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by perezju@chromium.org
, Nov 3 2016