Change-Id: I76a4b31e38a914313afc39b872c7814f6a25ef11

This lets us see Dart and non-Dart code more easily and allows the
visualization to aggregate the size of all Dart blobs.

Test: manual
Change-Id: If96756906e5b3917a9d6605b60124536146f3bdb

Error message should make it clear that push-apckages will not work with
"package_name" for now.

Can be reverted when BLD-338 is resolved

Change-Id: Ifac356eafc905ddc956b57984347b251c73ea683

This reverts commit 18556910.

ZX-3353 #comment

Change-Id: I626d4021c88db3c4efeedc6f0d82cf2f0e1f7c6c

This forks the visualization template and dependencies of the blobstats
tool and updates them to take into account features of blobs and
packages, instead of pretending everything is a symbol in a binary.

Improvements:
* Update all terminology (symbol->blob, directory->package)
* Add information about compressed and uncompressed sizes and reference
count on shared blobs
* Update colors to be more neutral
* Update labels on entries to be more accurate
* Update report naming and contents
* Remove dead links
* Add original and estimated compressed sizes to data model

Also moves the code to its own directory and imports the d3 library
instead of reaching into the Dart VM's internal directory.

Test: fx blobstats

Change-Id: I95cea2fa7e4c005d0917c991a726098326b00116

Before is was relying on the deprecated "bare_package_url"

CF-327  # Done

TEST=Manual

Change-Id: Iae9398ddba78d3f104e2a269d1f5581d00799e2b

There have been several bugs stemming from the fact that set was not changing
it's directory. It produces GN arguments, many of which want to be relative
to $FUCHSIA_DIR, rather than absolute. The build has similar invariants, with
// being $FUCHSIA_DIR, and the build directory being the working directory
during build execution.

Test: fx set from sub-directory of root picks up a board file.
Bug: BLD-352 #done
Change-Id: If6a0e351ce4c5f52e1a6011387ce2fca27156934

fx dispatches to them directly rather than defining a script in
devshell.

Change-Id: I98cec1ffaa5de1400edee8f4334de71940414002

This enables SSH into qemu instances that have networking, without having to
bake SSH keys into the build artifacts.

Change-Id: I19aa146cd752622ab79018180cfdc06aee1f2a7c

--build-dir is now removed. It has been deprecated with notice for a long time.
--{product,board,package}s are deprecated flags, no have messages.

Additional documentation for --{board,product,monolith,preinstall,available}
--netboot is documented.

Example usage added.

Change-Id: Ie8a3d4f2602c1f98d9c93bd35d9586a9c7b2c94f

This teaches blobstats to produce a size report into a directory other
than the build dir.

Test: fx blobstats -o /tmp/sdflkj
Change-Id: I2a5d7e85498977abf0ab178f3200fc87e6e9cbc6

This uses the size of blobs as reported by the blobfs tool for
computation.

It still gathers the size on the disk of the host machine and computes
compression estimates (if asked) since that will be useful for future
visualizations.

Test: fx blobstats
ZX-3303 #comment use blobfs recorded sizes in blobstats

Change-Id: I305272339169f1141173ec14991e7e240898bfdc

Change-Id: If39a88ad77c845fc540e73c45d4e09f3fd9222cc

CF-491

Test=manual

Change-Id: I65a5a5ffbb3c6db7cbfda89792b4a7c58e52259c

This CL changes an error message produced by verify_layer.py. The
message is generated when an 'all' package doesn't contain a
package that was found in the packages/prod directory. The message
was:

    Missing dependency in <all>: <package>

This can be misinterpreted to mean that <package> is imported in
<all> and doesn't exist. The new message is:

    The "all" package <all> does not import package <package>

TEST: ./scripts/packages/verify_layer.py --layer garnet \
      --json-validator ./out/x64/host_x64/json_validator
Change-Id: Id86a3f9dfd98ba3697f756f1b0957b295baa94ac

This adds completion for fx cp styled after zsh completion for scp. It
completes local and remote files and directories as required. It can't
use the same _remote_files helper that scp uses because Fuchsia systems
don't have a POSIX compliant ls that accepts -d1FL arguments. See:
 - http://pubs.opengroup.org/onlinepubs/009695399/utilities/ls.html
 - https://github.com/zsh-users/zsh/blob/master/Completion/Unix/Type/_remote_files

Change-Id: I7d2f0a6f8c4e6955303358561d1570cf8ca86864

ZX-3303 #done
Test: Run manually, see size go down.

fx blobstats (default: No compression)
fx blobstats -z
fx blobstats -l

Change-Id: Ifcb4768a9087f047e571b582843ed804980519bd

Change-Id: I8de80c3fad7f773e857097f2ca72f54e5d607dce

This approach prevents argument escaping / corruption problems by largely
avoiding parsing any extra arguments. This also enables access to more
runtests arguments, such as those associated with asan and so on.

Change-Id: I7662ac43a45013d054f8965252fa6f5c4cd8f0fa

This is necessary for `fx run-test foo -- --gtest_filter=Foo.*` to work
correctly. Otherwise, the command invokes:
  run_test_component fuchsia-pkg://foo --gtest_filter Foo.*
and gtest cannot parse the split parameter.

Tested: fx run-test
Change-Id: I161bd54ae914c9d5190287f31f9caf55ea3c817e

fx-standard-switches strips = from arguments past --, which should be
left intact and passed to the test invocation. Instead, filter the
arguments directly from the run-test arguments.

CF-324
Test: (pending local changes component-izing Bluetooth tests)
fx run-test bluetooth_tests -t bt-host-unittests -- --gtest_filter=\*

Change-Id: I235d5d18f4b23a5083c38dc404a8b4501ddd451d

Invoke pm directly instead of proxying through fx, similar to how
serve-updates invokes it.  When building product configs that don't
include pm, "fx pm" fails to find the binary.

Test: manual
Change-Id: Id585f52de81ca9c1cdd94ec127e5a0f5126c7763

This updates the blobstats script to display the paths to blobs based
on the path name used by the package containing them. The underlying
storage charges and proportional counts are still computed on a
blob-by-blob bases, based off of their hash. This uses the blobs.json
metadata file generated by the build to determine the paths within
packages.

Also restructures the internals of blobstats to reflect that blobs
don't have a meaningful path outside the context of a particular
package, and avoids recomputing hashes of blobs to speed up the
calculations and simplify the code.

Also marks unique blobs as unique.

Test: run 'fx blobstats' on builds including prebuilt_package entries
BLD-342 #done

Change-Id: I0a6a8d40ae8ad77d362068b5fc58fcd7390b83d2

Also, we always redirect kernel logs to a well-known path for cleaner terminal output.

Test: `fx net-run ls /pkg`

Change-Id: I4882d169ea1895835b5dd550042fb30db463006c

Change-Id: I9df2cd2b89ba5c9594c2d1de73293f16263d0958

* this comes in handy when the package has a lot of tests

Change-Id: Ic47208fb68becf96b42e4f5f1893467d59944bae

Test: builds and runs.
Change-Id: I50aedf07d7ed3d268546640c39f60c058b4da5ca

Use the StrictHostKeyChecking=no and UserKnownHostFile=/dev/null to
match the in-tree experience and prevent warnings when a device is
repaved with the same key.

Test: `bazel run` the same component across paving with the same ssh
       key.
Change-Id: Ia5f98845b003da934ae5e655d39b2f141f672b98

Test: bazel run flutter:package -- app --ssh-keys $PATH_TO_SSH_KEY
      Verified that "[INFO:component.cc(205)] Found pkg/data/enable_interpreter. Passing --enable_interpreter" was in the log
Bug: DX-886

Change-Id: Iae7d76d368c518810c622fb153c02197d1eadcfd

Note some tests still report no coverage data, tracked by
https://github.com/flutter/flutter/issues/20551.

Test: Built topaz, ran scripts/report_coverage.py
Change-Id: I6d58dc0b3ead74644c32e710f8f7e76e6a73724c

This reverts commit 4b45a9a8.

Reason for revert: We should use `fvm_image_size` instead.

Original change's description:
> Add argument for specifying qemu disk size
> 
> `-S <size>` can now be used immediately after `fx run` to specify the
> qemu disk size. Acceptable sizes are anything that qemu-img accepts.
> 
> We have also added a help text for `run` that describes this new option.
> `fx help run` and `fx run -h` both show this help text.
> 
> Argument to pass to `run-zircon` now need to be separated by a `--`, and
> arguments to pass to `qemu` by `-- --`.
> 
> Bug: None
> Test: `fx run -- -k`, `fx run -S 2G`, `fx run -S 2G -- -k`, `fx run -h`, `fx run -- -h`
> Change-Id: Idebb7466890bf59f8b9dbb90de34adfdec54391b

TBR=mcgrathr@google.com,raggi@google.com,porce@google.com,awolter@google.com

# Not skipping CQ checks because original CL landed > 1 day ago.

Bug: None
Change-Id: Id166dd872b031872f31752893e13d69454b7176e

Fixed typo ("xcode-select install" does not work. The command should be:
"xcode-select --install".)

Added logic to check for the need to install the xcode command line
tools, and a new check for possible need to "switch" xcode-select
to the command line tools. (CommandLineTools directory contains
/usr/include and C++ header files, but the XCode application
developer directory does not.)

Added new info message to let the user know that their environment
looks good, if there were no issues found.

Change-Id: I37aab02d33145e34c51b87a3feca959324187fd7

Also remove device flag because it no longer works

Change-Id: I059c9c418136c34202a09dfdc2903e6e7b6a5684

verify "cd" does not output anything to stdout, since many
other scripts assume this.

Note that check_cd optionally prints recommendations for
resolving the issue within the developer's shell environment.

For bash users only, doctor calls
scripts/devshell/lib/bashrc_checkup.sh,
which will attempt to load their ~/.bashrc
file, to allow doctor to check for conflicts in the interactive
shell environment (e.g., functions like overriding "cd").

For users using non-bash shells (like zsh) this current iteration
of "doctor" will still check environment variables and files
through the non-interactive bash script, but we may want to add
a "zshrc_checkup.zsh" script as well if we want to check for zsh-specific
interactive shell conflicts. (The bash "doctor" could still
launch other non-bash shell checks.)

Updated "doctor" script format and error handling a bit. Needs more
work to be easier to use and easier to add more checks.

Added --indent flag to style.sh and moved common terminal output
style functions, originally in doctor, to
devshell/lib/common_term_styles.sh, for reusability.

Change-Id: I3b054609e87274f49479c93c3a6c2e29bb7136eb

Also added run-image-test for tests which are in system image, i.e which
go in /system/test

Change-Id: I03b2a0388d5da33d76c2e9e43a182663e6761a52

Change-Id: I5c5a2c2c2f3fa1dc440dcc02b5d467d8def4ac9d

Change-Id: I9bdec7efa560d1fc94731d24df4013ad1ad16a92

Better reverse video for multiline text.

Usage and help including option to list style options.

Visual test script in //scripts/tests

Also added an automated test and "expected" files

Change-Id: Ie095c31e01bc3ebdc384d3d13d5d7fb151f948ce

Patched with some code optimizations. Output file descriptor is
now parameterized (figured out how to make this work without eval).
All stylized output is now combined into a single printf call.

Patched to allow user to override standard styles for error,
warning, info, and link, to accommodate preferences and different
screen backgrounds (dark and light).

Change-Id: Ib443044fb42dc85ad55a863b8284304f5af0a35d