-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fast_job_submission: add new guide #195
base: master
Are you sure you want to change the base?
Conversation
037b34b
to
ea9d246
Compare
re-pushed, I decided to put the tutorial under a new "how to" section of tutorials. The idea is that the "how to" topics will likely involve multiple commands or multiple prior topics, used together to describe something. |
@chu11 I think (my preference) for the time being since we have an entire jobs section would be to keep the tutorial under there, and when it's warranted to re-organized we think of all the pages in this section in that context. We are also working on the Command tutorials section, and I think it's going to get too watered down to start with "Howto" and "Commands." Arguably, everything is a "How to" and it's a category that moreso reflects we don't know exactly where to put it (and I'm going to suggest the well-established Jobs section for now). |
ea9d246
to
549e49b
Compare
yeah, i feel its a little bit in between the two. But lets go with the jobs section for now, moved it back. |
549e49b
to
167f883
Compare
rebased and re-pushed, "sub-instance" -> "subinstance" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this tutorial is great and I don't see any issues, however I'm not experienced with this kind of submission.
167f883
to
7136da8
Compare
re-pushed, cut and pasted |
7136da8
to
47a1881
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Very nice!
jobs/fast-job-submission.rst
Outdated
|
||
Jobs can be asynchronously submitted via several mechanisms. This will allow us to significantly reduce the slow iterative process of submitting jobs one by one. | ||
|
||
The first mechanism is the ``--cc`` (carbon copy) roption in ``flux mini submit``. It will allow the user to replicate every id specified in an :ref:`IDSET<idset>`. Along with the ``{cc}`` substitution string, we can submit all 1000 scripts on the command line like so: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The first mechanism is the ``--cc`` (carbon copy) roption in ``flux mini submit``. It will allow the user to replicate every id specified in an :ref:`IDSET<idset>`. Along with the ``{cc}`` substitution string, we can submit all 1000 scripts on the command line like so: | |
The first mechanism is the ``--cc`` (carbon copy) option in ``flux mini submit``. It will allow the user to replicate every id specified in an :ref:`IDSET<idset>`. Along with the ``{cc}`` substitution string, we can submit all 1000 scripts on the command line like so: |
47a1881
to
1aa6d17
Compare
re-pushed, with comment fixes from above and removing "flux mini" references |
Add new guide to improve job submission speed in Flux.
1aa6d17
to
73f9061
Compare
Add new guide to improve job submission speed in Flux. I was on and off writing this for a bit, finally decided to write it for real.
Note, for now I just stuck this stupidly under "jobs" set of docs. I'm pretty sure its not the right place.
Possibly a "guide" section under tutorials? Ehhh?