commit b1e0532418e4631af01acbc0cedd426f1905f4af Author: Jenkins Build Slave User Date: Tue Feb 21 15:12:34 2017 +0000 0.94.10 commit 83af8cdaaa6d94404e6146b68e532a784e3cc99c Merge: 5855083 5485b49 Author: Nathan Cutler Date: Mon Jan 23 17:49:54 2017 +0100 Merge pull request #13041 from SUSE/wip-18448-hammer hammer: osd: filestore: FALLOC_FL_PUNCH_HOLE must be used with FALLOC_FL_KEEP_SIZE Reviewed-by: Sage Weil commit 585508358f6412b179175a7812b76330ec5dda0d Merge: 4e4d3f0 eabe906 Author: John Spray Date: Mon Jan 23 12:26:27 2017 +0100 Merge pull request #13022 from SUSE/wip-18602-hammer hammer: cephfs test failures (ceph.com/qa is broken, should be download.ceph.com/qa) Reviewed-by: John Spray commit 4e4d3f0fd86840609940f6b336f6aaf54a8695bc Merge: 9036fee cf9678c Author: John Spray Date: Mon Jan 23 12:25:43 2017 +0100 Merge pull request #13039 from SUSE/wip-fs-thrash-xfs tests: run fs/thrash on xfs instead of btrfs Reviewed-by: John Spray commit eabe9064aed3693599e3b6053b57eafb835d35da Author: John Spray Date: Tue Jan 17 17:12:46 2017 +0100 qa: update remaining ceph.com to download.ceph.com Fixes: http://tracker.ceph.com/issues/18574 Signed-off-by: John Spray (cherry picked from commit 549d993d3fd8ffffa280ed4a64aca41d1c6f2da1) commit 5485b49da39b9f07a4216ff26f8ec9e04590ddf8 Author: Nathan Cutler Date: Sat Jan 21 14:54:52 2017 +0100 os/filestore: FALLOC_FL_PUNCH_HOLE must be used with FALLOC_FL_KEEP_SIZE Signed-off-by: xinxin shu (cherry picked from commit 7bd95b595fddb8a4e618a2c7df1ba04eccf0829d) Conflicts: src/os/FileStore.cc (in master, this file is in a different location) commit cf9678c998600e76e94777b2904ba3047d051bb8 Author: Nathan Cutler Date: Sat Jan 21 14:24:25 2017 +0100 tests: run fs/thrash on xfs instead of btrfs Signed-off-by: Nathan Cutler commit 9036feed9bd9f386dc013dee8326071ef0b4cbee Merge: 33c7ab7 fa5c625 Author: Nathan Cutler Date: Sat Jan 21 10:00:04 2017 +0100 Merge pull request #12824 from SUSE/wip-18449-hammer hammer: [teuthology] update rbd/singleton/all/formatted-output.yaml to support ceph-ci commit 33c7ab7480aa8d0ee80d6a47f91f4488515e07f8 Merge: ef8ae1f ef513a7 Author: Nathan Cutler Date: Fri Jan 20 23:10:10 2017 +0100 Merge pull request #12906 from SUSE/wip-15943-hammer hammer: osd/PG: fix cached_removed_snaps bug in PGPool::update after map gap Reviewed-by: Samuel Just commit ef8ae1ff13b297c68ed4f1d0e01aba8d20dc5007 Merge: c51602f 8bab745 Author: Nathan Cutler Date: Fri Jan 20 23:02:05 2017 +0100 Merge pull request #12805 from SUSE/wip-18432-hammer hammer: ceph-create-keys loops forever Reviewed-by: Nathan Cutler commit c51602f0106e3681c143a2cfd94a08428e966caf Merge: 48687c7 83e7f17 Author: Jason Dillaman Date: Tue Jan 17 08:39:14 2017 -0500 Merge pull request #12957 from SUSE/wip-18544-hammer hammer: [teuthology] update Ubuntu image url after ceph.com refactor Reviewed-by: Jason Dillaman commit 83e7f178c9a0b70305644ca30598c1b1ff4d0474 Author: Jason Dillaman Date: Mon Jan 16 22:12:51 2017 -0500 qa/tasks/qemu: update default image url after ceph.com redesign Fixes: http://tracker.ceph.com/issues/18542 Signed-off-by: Jason Dillaman (cherry picked from commit 6d17befb3bbc3d83c9d23d763ad95e1e7b2e4be0) commit ef513a78062569de081311b50fffdf59d4031ea7 Author: Samuel Just Date: Mon Dec 12 10:35:38 2016 -0800 PG: fix cached_removed_snaps bug in PGPool::update after map gap 5798fb3bf6d726d14a9c5cb99dc5902eba5b878a actually made 15943 worse by always creating an out-of-date cached_removed_snaps value after a map gap rather than only in the case where the the first map after the gap did not remove any snapshots. Introduced: 5798fb3bf6d726d14a9c5cb99dc5902eba5b878a Fixes: http://tracker.ceph.com/issues/15943 Signed-off-by: Samuel Just (cherry picked from commit 5642e7e1b3bb6ffceddacd2f4030eb13a17fcccc) commit fa5c6250125a51e61e34aa9586cc917df7458138 Author: Nathan Cutler Date: Sat Jan 7 13:48:51 2017 +0100 tests: subst repo and branch in qemu test urls References: http://tracker.ceph.com/issues/18440 Signed-off-by: Nathan Cutler (cherry picked from commit 2484a5546160560a4050d35400a6edce37ae48ad) Conflicts: (hammer doesn't have these files) qa/suites/rbd/maintenance/qemu/xfstests.yaml qa/suites/rbd/qemu/workloads/#qemu_xfstests.yaml# commit 572cd2660f5bf1cc7f980831d12bb3075816b96f Author: Nathan Cutler Date: Sat Jan 7 13:45:10 2017 +0100 tests: subst branch and repo in qa/tasks/qemu.py References: http://tracker.ceph.com/issues/18440 Signed-off-by: Nathan Cutler (cherry picked from commit 74689df754561e11a3377998840efcea9e780755) commit 237fb80f2b2874329aed25ba655a6789e1707114 Author: Nathan Cutler Date: Fri Jan 6 21:06:11 2017 +0100 tests: subst repo name in qa/tasks/cram.py Inspired by bcbe45d948f1c4da02e27b3be5f29a8b52745e28 Fixes: http://tracker.ceph.com/issues/18440 Signed-off-by: Nathan Cutler (cherry picked from commit 56e37e41f4dddd289dd3c1886b192cd328ed311b) commit 6045a83a438918f445504224b80809dfe715c9b0 Author: Venky Shankar Date: Fri Dec 9 15:11:49 2016 +0530 cram: support fetching from sha1 branch, tag, commit hash Signed-off-by: Venky Shankar (cherry picked from commit d2f0d745987a2e2eee4e1822146aad8da5d42708) Conflicts: suites/krbd/unmap/tasks/unmap.yaml (hammer doesn't have this) suites/rbd/singleton/all/formatted-output.yaml (moved to qa/, trivial resolution) commit 48687c79adf489b27af15bb44205913acc89af7a Merge: 61917cb ac62d79 Author: Orit Wasserman Date: Sun Jan 8 09:26:03 2017 +0200 Merge pull request #12227 from ceph/wip-orit-resharding-hammer Wip orit resharding hammer Reviewed-by: Orit Wasserman commit 8bab74537f5891f2b97f0fb6722e2e00416b723a Author: Alfredo Deza Date: Wed Nov 2 12:28:49 2016 -0400 ceph-create-keys: wait 10 minutes to get or create the bootstrap key, not forever Signed-off-by: Alfredo Deza (cherry picked from commit bea802bd13df883d06b7b67a83ac6540e44ab6c1) commit a7d919100e9e78b7f821da76b338bca24f374a0a Author: Alfredo Deza Date: Wed Nov 2 12:25:32 2016 -0400 ceph-create-keys: wait 10 minutes to get or create a key, not forever Signed-off-by: Alfredo Deza (cherry picked from commit 8f84681a4d97a7ea6bc04e759eccfc40204a2fdb) Conflicts: src/ceph-create-keys ( hammer does not have 52e978e4b3660baa9f50b1bb8247909b672142e7 ) commit 7b3bc5fbc55da3cb2ce036ef3df367832d7a59e2 Author: Alfredo Deza Date: Wed Nov 2 12:19:10 2016 -0400 ceph-create-keys: wait for quorum for ten minutes, not forever Signed-off-by: Alfredo Deza (cherry picked from commit 32cedd2c18e48d5f9a1547e5fd69c24c7eac1638) commit 61917cbcb7a4e35aa0ae8718377526ae55b5b7cf Merge: 7b1f8fe 7106f42 Author: Samuel Just Date: Thu Jan 5 09:15:13 2017 -0800 Merge pull request #11615 from mslovy/wip-17610-hammer hammer: osd: fix fiemap issue in xfs when #extents > 1364 Reviewed-by: Samuel Just commit 7b1f8fe4c97b6c8ef81d899f0a24235946cc585a Merge: 5ba3c08 5f00e1d Author: Samuel Just Date: Thu Jan 5 09:14:10 2017 -0800 Merge pull request #11936 from SUSE/wip-16432-hammer hammer: librados: bad flags can crash the osd Reviewed-by: Samuel Just commit 5ba3c0873d10b247a45bfbc1cb483cfc2189a9fd Merge: b44e1db 8312dc6 Author: Samuel Just Date: Thu Jan 5 09:12:55 2017 -0800 Merge pull request #12121 from dzafman/wip-16225-min hammer: common: SIGABRT in TrackedOp::dump() via dump_ops_in_flight() Reviewed-by: Samuel Just commit b44e1db11b0d7310f2563fa7acfb1464db4b04fb Merge: 7bfb05b 92de2fd Author: Samuel Just Date: Thu Jan 5 09:11:57 2017 -0800 Merge pull request #12266 from SUSE/wip-18109-hammer hammer: msgr: simple/Pipe: error decoding addr Reviewed-by: Samuel Just commit 7bfb05b00157fa40c053eeefb59cd3bb211fc2b3 Merge: 715012b fe77c9a Author: Samuel Just Date: Thu Jan 5 09:11:34 2017 -0800 Merge pull request #12417 from SUSE/wip-18132-hammer hammer: osd: ReplicatedBackend::build_push_op: add a second config to limit omap entries/chunk independently of object data Reviewed-by: Samuel Just commit 715012bebe6e7838c702aae0283f1c3d37428762 Merge: a20ad42 e9311dd Author: Samuel Just Date: Thu Jan 5 09:11:13 2017 -0800 Merge pull request #12759 from SUSE/wip-18399-hammer hammer: tests: objecter_requests workunit fails on wip branches Reviewed-by: Samuel Just commit a20ad42ecab39541107e01ac4516a0a71e379846 Merge: 3e62a1d 67e2101 Author: Samuel Just Date: Thu Jan 5 09:10:54 2017 -0800 Merge pull request #12762 from SUSE/wip-18405-hammer hammer: Cannot reserve CentOS 7.2 smithi machines Reviewed-by: Samuel Just commit 3e62a1d5dbd2ee6672388121be26afd5d0374f5f Merge: 77fa49f aa91bc7 Author: Samuel Just Date: Thu Jan 5 09:10:28 2017 -0800 Merge pull request #12685 from SUSE/wip-18273-hammer hammer: tests: Workunits needlessly wget from git.ceph.com Reviewed-by: Samuel Just commit 77fa49f67d1c8c59d9131e6f52e595661ceda8f2 Merge: 2c164b7 c28d5ea Author: Samuel Just Date: Thu Jan 5 09:09:59 2017 -0800 Merge pull request #12687 from SUSE/wip-18281-hammer hammer: mon: osd flag health message is misleading Reviewed-by: Kefu Chai commit 2c164b73af9de4196821d9214fb7598ac88ef509 Merge: dfefeda 996fc25 Author: Nathan Cutler Date: Thu Jan 5 15:20:28 2017 +0100 Merge pull request #12423 from SUSE/wip-18222-hammer hammer: tests: qemu/tests/qemu-iotests/077 fails in dumpling, hammer, and jewel Reviewed-by: Jason Dillaman commit dfefeda86e3e6761bc4a59cee960d807609344e4 Merge: b0648f8 0c5ebf4 Author: Nathan Cutler Date: Wed Jan 4 20:15:21 2017 +0100 Merge pull request #12744 from SUSE/wip-18385-hammer hammer: tests: Cannot clone ceph/s3-tests.git (missing branch) Reviewed-by: Orit Wasserman commit b0648f85ee67da82ac8fb7e8f4c1546aa560bfda Merge: c45896a e97ceb1 Author: Nathan Cutler Date: Wed Jan 4 11:43:29 2017 +0100 Merge pull request #12418 from SUSE/wip-18218-hammer hammer: rgw sends omap_getvals with (u64)-1 limit Reviewed-by: Orit Wasserman commit c45896a86810f02b86b3c355855eb70a998a3c9a Merge: 811213e db2d112 Author: Nathan Cutler Date: Wed Jan 4 11:37:29 2017 +0100 Merge pull request #12619 from Werkov/wip-18317-hammer hammer: rgw: TempURL in radosgw behaves now like its Swift's counterpart. Reviewed-by: Orit Wasserman commit db2d112f22a525bfffb62e85747769a4b30f7375 Author: Radoslaw Zarzynski Date: Fri Mar 4 16:30:50 2016 +0100 rgw: TempURL in radosgw behaves now like its Swift's counterpart. Signed-off-by: Radoslaw Zarzynski (cherry picked from commit a1ea7180969dcbaf88dfcc1bfafb17e82639df64) Conflicts: src/rgw/rgw_swift.cc - replace C++11 constructs, - s->info.method is actually unconditional member of allowed_methods, which was opaqued by C++11 ctors - drop temp_url_make_content_disp() which has no use with hammer's req_state commit 811213ef9df188c8cf21dec5aeab08093af483d7 Merge: 9a8aaca 47e7202 Author: Nathan Cutler Date: Tue Jan 3 15:31:27 2017 +0100 Merge pull request #12312 from YankunLi/fix_parameter_check hammer: rbd: fix parameter check Reviewed-by: Jason Dillaman commit 9a8aaca56e48aae78dff27a969e2398c332f2b09 Merge: 78e3451 c4f1b42 Author: Nathan Cutler Date: Tue Jan 3 15:31:03 2017 +0100 Merge pull request #12446 from dillaman/wip-18111 hammer: librbd: diffs to clone's first snapshot should include parent diffs Reviewed-by: Jason Dillaman commit 78e34519f9e3c72aa91587593dcb23dac4ade3a3 Merge: a9de35a 0f83bb7 Author: Nathan Cutler Date: Tue Jan 3 15:23:07 2017 +0100 Merge pull request #12398 from linuxbox2/hammer hammer: rgw: do not abort when accept a CORS request with short origin Reviewed-by: Orit Wasserman commit a9de35a27cb7d57f8094de78f550291b1b45b944 Merge: 3ef8d8c a602e2b Author: Jason Dillaman Date: Tue Jan 3 09:17:35 2017 -0500 Merge pull request #12758 from SUSE/wip-18397-hammer hammer: tests: OSDs commit suicide in rbd suite when testing on btrfs Reviewed-by: Jason Dillaman commit 67e2101ffa2b4defe07dec30b12cc37c9f2ed488 Author: Nathan Cutler Date: Tue Jan 3 14:53:27 2017 +0100 qa/distros: add centos yaml; use that instead Modeled after https://github.com/ceph/ceph/pull/12632 Fixes: http://tracker.ceph.com/issues/18405 Signed-off-by: Nathan Cutler commit e9311ddb60638c1dd39325e279b97c9a7d09b8a4 Author: Sage Weil Date: Thu Dec 15 13:35:02 2016 -0500 qa/tasks/admin_socket: subst in repo name It is either ceph.git or ceph-ci.git. Signed-off-by: Sage Weil (cherry picked from commit bcbe45d948f1c4da02e27b3be5f29a8b52745e28) commit a602e2bf2e1cae8d21ae215c35a611cc99b6c7c9 Author: Nathan Cutler Date: Tue Jan 3 11:26:26 2017 +0100 rbd: only test on xfs btrfs is not recommended for production See 5864d56592ef3ffe765aa1ef0865610dbc7e8725 for precendent. Signed-off-by: Nathan Cutler commit aa91bc7df963728e6a4d4db1086214e7873fc2e7 Author: Nathan Cutler Date: Mon Jan 2 22:49:13 2017 +0100 tests: rbd/test_lock_fence.sh: fix rbdrw.py relative path This commit fixes a regression introduced by cf294777ea92f0911813a7132068584d4f73a65a Fixes: http://tracker.ceph.com/issues/18388 Signed-off-by: Nathan Cutler (cherry picked from commit 91231de16dbe4d0e493ec617165a2b38078d122b) commit 0c5ebf4adf26274802ec4cff229b2272dc4a4266 Author: Orit Wasserman Date: Mon Jan 4 10:03:08 2016 +0100 use ceph-master branch for s3tests Signed-off-by: Orit Wasserman (cherry picked from commit 21160124028ab123b5c547499d911b0a1397214f) Conflicts: (trivial resolution) qa/suites/rgw/multifs/tasks/rgw_s3tests.yaml qa/suites/rgw/verify/tasks/rgw_s3tests.yaml qa/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml commit 3ef8d8c6f0ef712dcff207fb6ef17887bd8719d7 Merge: e038662 d18240f Author: Nathan Cutler Date: Mon Jan 2 20:34:42 2017 +0100 Merge pull request #12743 from SUSE/wip-18383 hammer: tests: populate mnt_point in qa/tasks/ceph.py Reviewed-by: Loic Dachary commit d18240f679840bdaeec1e3f7cdd9164b4406673c Author: Nathan Cutler Date: Mon Jan 2 14:22:43 2017 +0100 qa/tasks/ceph.py: populate mnt_point in hammer In hammer, there is no "mnt_point" variable, yet 53225d5 was cherry-picked to hammer - see 87e0299448908775600c62130617bad503027768 and https://github.com/ceph/ceph/pull/12455 This caused lots of "NameError: global name 'mnt_point' is not defined" errors in hammer integration testing. This is not a cherry-pick, because the mnt_point variable was introduced by a54ff597faa379c8fd369352fb924651be269f95 ("tasks/ceph: convert cluster creation to work with multiple clusters") which was not backported to hammer. Fixes: http://tracker.ceph.com/issues/18383 Signed-off-by: Nathan Cutler commit ac62d7996b95d8fdd5665e490fc09506c8fe9e68 Author: weiqiaomiao Date: Mon Oct 31 13:59:55 2016 +0800 rgw: fix osd crashes when execute "radosgw-admin bi list --max-entries=1" command Fixes: http://tracker.ceph.com/issues/17745 Signed-off-by: weiqiaomiao (cherry picked from commit 51a4405a1ef59671cbd51c530a84333359d3f3dd) commit 530d1e22920bd843d34ceffccad346fd5003c075 Author: Orit Wasserman Date: Tue Nov 29 13:36:37 2016 +0100 rgw: use hammer rgw_obj_key api Signed-off-by: Orit Wasserman commit e396b37af147770434147c5bd0377e8624254cd9 Author: Orit Wasserman Date: Tue Nov 29 13:15:05 2016 +0100 Revert "rgw: rgw_obj encoding fixes" This reverts commit c1b64c8f9c23473b758300958a94a172f1d39b64. Signed-off-by: Orit Wasserman commit a3e9865058e12fff18ee7674fcfd8435a1a37bf4 Author: Sage Weil Date: Thu Dec 22 13:05:22 2016 -0500 qa/tasks/workunit: clear clone dir before retrying checkout If we checkout ceph-ci.git, and don't find a branch, we'll try again from ceph.git. But the checkout will already exist and the clone will fail, so we'll still fail to find the branch. The same can happen if a previous workunit task already checked out the repo. Fix by removing the repo before checkout (the first and second times). Note that this may break if there are multiple workunit tasks running in parallel on the same role. That is already racy, so if it's happening, we'll want to switch to using a truly unique clonedir for each instantiation. Fixes: http://tracker.ceph.com/issues/18336 Signed-off-by: Sage Weil (cherry picked from commit 2a7013cd5a033c5be43350505d75f088e831e201) commit a70e0d58e10184b0903ba36c047a237be3c7cc19 Author: Sage Weil Date: Fri Dec 16 15:06:16 2016 -0500 qa/tasks/workunit: retry on ceph.git if checkout fails Signed-off-by: Sage Weil (cherry picked from commit 72d73b8c8836ae35c518fa09f44805a74038f02a) commit c28d5ea7107427175ef3f6089aaa36c97c2919bc Author: Sage Weil Date: Wed Dec 7 09:50:26 2016 -0500 mon/OSDMonitor: only show interesting flags in health warning Also add PAUSEREC flag into the list. Fixes: http://tracker.ceph.com/issues/18175 Signed-off-by: Sage Weil (cherry picked from commit 26220f0608f5ed4a7d97fb8d10d0d12a0fcf5583) Conflicts: src/mon/OSDMonitor.cc (hammer lacks CEPH_OSDMAP_FULL and order of flags is slightly different) commit d1c654ea3f3b8c194f3fdc7295cb379c6270d6b3 Author: Sage Weil Date: Mon Dec 19 14:08:11 2016 -0500 qa/workunits: include extension for nose tests When you have a relative path you have to include the extension. Weird. Signed-off-by: Sage Weil (cherry picked from commit 5666fd61d6dbd40be1d79354227cabd562e829ea) Conflicts: qa/workunits/fs/test_python.sh (not in hammer) qa/workunits/rbd/test_librbd_python.sh (no valgrind in hammer) commit eaa51f6f907019727eb18fc4174fe4f2d04f396a Author: Sage Weil Date: Thu Dec 15 15:10:28 2016 -0500 qa/workunits: use relative path instead of wget from git Signed-off-by: Sage Weil (cherry picked from commit cf294777ea92f0911813a7132068584d4f73a65a) Conflicts: (all trivial) qa/workunits/fs/test_python.sh qa/workunits/rados/test_python.sh qa/workunits/rbd/rbd_mirror.sh qa/workunits/rbd/rbd_mirror_stress.sh qa/workunits/rbd/test_librbd_python.sh qa/workunits/rbd/test_lock_fence.sh commit 8eb4e8b6fd6c803fa9bea781db07c54d901e34cc Author: Sage Weil Date: Thu Dec 15 13:26:14 2016 -0500 qa/tasks/workunit.py: add CEPH_BASE env var Root of git checkout Signed-off-by: Sage Weil (cherry picked from commit 27b8eac24922f8b4bd065e6e7f0bc8e2ba37b5d5) commit dccf904241f2a00ba0317135bd3cbe56c6dfdb80 Author: Sage Weil Date: Thu Dec 15 13:25:23 2016 -0500 qa/tasks/workunit: leave workunits inside git checkout Signed-off-by: Sage Weil (cherry picked from commit 4602884ab8f5a256d13091f7239d938990482d95) commit e038662d80ec1c59edb3d6a1c63197ca387d26b2 Merge: 12d6781 59878b3 Author: Sage Weil Date: Wed Dec 14 11:40:08 2016 -0600 Merge pull request #12455 from liewegas/qa-suite-hammer hammer: merge ceph-qa-suite commit 59878b3bf775fabf0f4c168e67d6f473e69c15a1 Merge: 12d6781 7ed0dce Author: Sage Weil Date: Wed Dec 14 11:30:00 2016 -0600 merge ceph-qa-suite commit 7ed0dce3cf7ded278e59a9b36d3fd713e3c42b8d Author: Sage Weil Date: Wed Dec 14 11:29:55 2016 -0600 move ceph-qa-suite dirs into qa/ commit 08ce5441dbad8754205717a20d6273c0a099777a Author: Sage Weil Date: Wed Dec 14 12:27:47 2016 -0500 Revert "tasks/workunit.py: depth 1 clone" This reverts commit 12a707cb0f7b162e15c31915eb677bbd49b5e2cf. commit 12a707cb0f7b162e15c31915eb677bbd49b5e2cf Author: Sage Weil Date: Wed Dec 14 12:19:44 2016 -0500 tasks/workunit.py: depth 1 clone Signed-off-by: Sage Weil (cherry picked from commit 4faf77a649cb3f8ddf497ca81937b3dbf63a18dc) commit 6bdc3bb6a00480b721b9795bd5e132b1dbf04ac0 Author: Sage Weil Date: Wed Dec 14 12:18:29 2016 -0500 tasks/workunit: remove kludge to use git.ceph.com This was hard-coded to ceph.git (almost) and breaks when you specify --ceph-repo. Remove it entirely. We'll see if github.com is better at handling our load than it used to be! Signed-off-by: Sage Weil (cherry picked from commit 159c455a0326eef2c017b3e3cf510f918b5ec76c) commit 87e0299448908775600c62130617bad503027768 Author: Kefu Chai Date: Sat Dec 10 02:36:52 2016 +0800 tasks/ceph: restore context of osd mount path before mkfs all newly created files and directories under the mount dir inherit the SELinux type of their parent directory. so we need to set it before mkfs. Fixes: http://tracker.ceph.com/issues/16800 Signed-off-by: Kefu Chai (cherry picked from commit 53225d5272a1d35d4183fcfa55a139f55f77e122) commit ca933160bec3532a5b2846fc7e684f11509c8298 Merge: bbb2615 107e9c3 Author: Sage Weil Date: Mon Dec 12 16:42:55 2016 -0600 Merge pull request #1278 from ceph/wip-16225-min hammer: SIGABRT in TrackedOp::dump() via dump_ops_in_flight() commit c4f1b42810339b5b45b48f74c3ff0ae661a8807a Author: Jason Dillaman Date: Mon Dec 12 11:53:00 2016 -0500 librbd: diffs to clone's first snapshot should include parent diffs If the clone has a backing object created after the snapshot that overwrites an extent of the parent, the parent diffs within that extent are not included in the result. Hammer-specific implementation due to librbd refactoring during the Infernalis release. Fixes: http://tracker.ceph.com/issues/18111 Signed-off-by: Jason Dillaman commit 996fc2575ef988e6b20fda9ca771b2f6f141cbd3 Author: Jason Dillaman Date: Wed Dec 7 09:59:39 2016 -0500 qa/workunits/rbd: removed qemu-iotest case 077 The test case is not stable due to racing console output. This results in spurious failures. Fixes: http://tracker.ceph.com/issues/10773 Signed-off-by: Jason Dillaman (cherry picked from commit 2c70df978d605a45ff81971b86f5afbefbdaabb6) commit e97ceb13242fd73b05a20b60208fee7f032e3ef3 Author: Yehuda Sadeh Date: Mon Nov 28 14:20:03 2016 -0800 rgw: omap_get_all() fixes Signed-off-by: Yehuda Sadeh (cherry picked from commit 99e866feb3f8aa0ff768d6253979b6b4fc0fa452) commit 38ab892201ce9ca95010e5f33277be2b0213e96d Author: Sage Weil Date: Mon Nov 21 18:37:39 2016 -0500 rgw/rgw_rados: do not omap_getvals with (u64)-1 max Fixes: http://tracker.ceph.com/issues/17985 This will make the OSD fall over if the object is big and the OSD doesn't impose it's own fail-safe limit. Signed-off-by: Sage Weil (cherry picked from commit 7cd123ec0dd5951628e4f8ddd4e044a0fbb82f2f) commit fe77c9a906fb0fbd85762c8c079d85ca106613ce Author: Wanlong Gao Date: Thu Jun 23 20:04:25 2016 +0800 osd: limit omap data in push op We already have the config osd_recovery_max_chunk to limit the total size of omap entries and omap data. But we need an individual config to limit the number of omap entries independently. We call this config osd_recovery_max_omap_entries_per_chunk here with the default number of 64000. Signed-off-by: Wanlong Gao (cherry picked from commit 56064c5cb645254574dbad00e6c16b783115bb93) commit 0f83bb7dbc5f81ecef0108b746f5bca58e76ff31 Author: LiuYang Date: Thu Dec 8 14:21:43 2016 +0800 rgw: do not abort when accept a CORS request with short origin Fixed: #18187 when accept a CROS request, the request http origin shorter than the bucket's corsrule (eg. origin: http://s.com corsrule: *.verylongdomain.com). the rgw_cors.cc::is_string_in_set() will have a wrong index, the radosrgw server will abort. $ curl http://test.localhost:8000/app.data -H "Origin:http://s.com" 0> 2016-12-05 03:22:29.548138 7f6add05d700 -1 *** Caught signal (Aborted) ** in thread 7f6add05d700 thread_name:civetweb-worker ceph version 11.0.2-2168-gd2f8fb4 (d2f8fb4a6ba75af7e6da0f5a7f1b49ec998b1631) 1: (()+0x50720a) [0x7f6b147c420a] 2: (()+0xf370) [0x7f6b09a33370] 3: (gsignal()+0x37) [0x7f6b081ca1d7] 4: (abort()+0x148) [0x7f6b081cb8c8] 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f6b08ace9d5] 6: (()+0x5e946) [0x7f6b08acc946] 7: (()+0x5e973) [0x7f6b08acc973] 8: (()+0x5eb93) [0x7f6b08accb93] 9: (std::__throw_out_of_range(char const*)+0x77) 0x7f6b08b21a17] 10: (()+0xbd97a) [0x7f6b08b2b97a] 11: (()+0x449c1e) [0x7f6b14706c1e] 12: (RGWCORSRule::is_origin_present(char const*)+0x48) [0x7f6b147073b8] 13: (RGWCORSConfiguration::host_name_rule(char const*)+0x37) [0x7f6b147074e7] 14: (RGWOp::generate_cors_headers(std::string&, std::string&, std::string&, std::string&, unsigned int*)+0xa3) [0x7f6b14593e63] 15: (dump_access_control(req_state*, RGWOp*)+0x61) [0x7f6b14653f91] Signed-off-by: LiuYang (cherry picked from commit 67d4d9e64bc224e047cf333e673bb22cd6290789) commit 47e72024e091a55a5fcd31853e143c94d850b00a Author: YankunLi Date: Mon Dec 5 14:39:20 2016 +0800 rbd: fix parameter check using import-diff command, the imagename must be specified. Signed-off-by: Yankun Li commit bbb261533455d37b4ef1e5bfc3c8f7765ab74e5a Merge: 8e5872b 4533623 Author: Sage Weil Date: Fri Dec 2 15:09:32 2016 -0500 Merge pull request #1276 from ceph/no-btrfs-on-hammer rados: remove btrfs tests; use xfs instead commit 7106f426c96978a0a41e9d1482239a4da505157e Author: Kefu Chai Date: Wed Nov 23 14:48:11 2016 +0800 FileStore::_do_fiemap: do not reference fiemap after it is freed `last` points to fiemap::fm_extends[n], and if fiemap gets freed, we can not reference any of its fieldis. so we could remember the check result before freeing it. Signed-off-by: Kefu Chai (cherry picked from commit c3748fa7737b6c43de2dae5d957fcff01322515c) Conflicts: src/os/FileStore.cc put the parameter is_last in the right place commit 92de2fd9a8b19c3d83d2567720f4e7ad21e43a63 Author: Sage Weil Date: Tue Nov 29 21:50:52 2016 -0500 msg/simple/Pipe: handle addr decode error Fixes: http://tracker.ceph.com/issues/18072 Signed-off-by: Sage Weil (cherry picked from commit 2f5cfbc0de5464ab80581c416413a86c3d38dfb7) commit 12d67814912514bb34ba61ceb45a744299d65ff2 Merge: 8406ee5 e1694d6 Author: Nathan Cutler Date: Tue Nov 29 22:16:34 2016 +0100 Merge pull request #11457 from tchaikov/wip-17558-hammer hammer: mon: send updated monmap to its subscribers Reviewed-by: Samuel Just Reviewed-by: Kefu Chai commit 8406ee58ca5c4abbe962ba5a4025aabe220e3981 Merge: bfda134 03af4aa Author: Nathan Cutler Date: Tue Nov 29 22:12:46 2016 +0100 Merge pull request #11628 from ceph/wip-hammer-11567 hammer: rgw: Don't loop forever when reading data from 0 sized segment. Reviewed-by: Orit Wasserman commit 5f00e1d4c04698c68248844aad31f4b36eff5735 Author: Jianpeng Ma Date: Wed Feb 11 11:18:41 2015 +0800 osd: Add func has_flag in MOSDOp. Signed-off-by: Jianpeng Ma (manually cherry picked just one line from d9a2ca5c5ae50dc34e184d577c7b24c56b6cc6ad) commit be7184589de9208986a2054491b86782dac938e8 Author: Sage Weil Date: Tue May 24 14:02:32 2016 -0400 osd: reject PARALLELEXEC ops with EINVAL Errors are better than crashing. Signed-off-by: Sage Weil (cherry picked from commit 407495197dd878b62f1356f6d939e33ab50d78c6) Conflicts: src/osd/ReplicatedPG.cc (trivial resolution) commit 8d352358edc156f70b5eb68c37bb56cb2392fce2 Author: Sage Weil Date: Tue May 24 14:02:14 2016 -0400 ceph_test_rados_api_misc: test rados op with bad flas Pass the bad PARALLELEXEC flag to remove(), which takes a flags arg. Signed-off-by: Sage Weil (cherry picked from commit 1aa807f4f29b4b016cc737ffa443e8f30c3b7693) Conflicts: src/test/librados/misc.cc (dropped ioctx.remove() test because there is no remove() in hammer librados) commit bfda134f6844d6e238052e4f1900f3d2e7497d5e Merge: 9bf08dd 0d2f431 Author: Nathan Cutler Date: Thu Nov 24 09:15:50 2016 +0100 Merge pull request #10437 from odivlad/fix-doc hammer: docs: Bucket object versions Reviewed-by: Orit Wasserman commit 03af4aae8103b52b19737c951e432efc7135b7ca Author: Marcus Watts Date: Thu Oct 13 21:12:36 2016 -0400 Don't loop forever when reading data from 0 sized segment. The 0 sized segment can arise depending on how the client uploads the object in the first place. The cpu loop then happens during a swift `GET'. Signed-off-by: Marcus Watts (cherry picked from commit 46c5f9773246522e66bb2cca49345d0b62a16c42) commit 8312dc61ceaa39dca675fda2cb7c88ec3c5ca9f7 Author: David Zafman Date: Mon Mar 14 13:28:39 2016 -0700 common/TrackedOp: Move tracking_enabled check into register_inflight_op() Make tracking_enabled (and the lock private.)* Signed-off-by: David Zafman (Partial cherry picked from commit 4e8e6172e8f6cc2adc63a429c32f5edd03982f5e) * Backport: Exclude locking since tracking_enabled can't change after launch commit c7220ccc0ec80bb6788befefe71f676c75457b70 Author: David Zafman Date: Thu Mar 10 21:24:25 2016 -0800 common/TrackedOp: Handle dump racing with constructor Use is_tracked to prevent TrackedOp::dump() from trying to call virtual function while still in OpRequest constructor. Fixes: #8885 Signed-off-by: David Zafman (cherry picked from commit ad13e05499669a79bde9a219ba1089f929e0388e) Conflicts: src/common/TrackedOp.cc src/common/TrackedOp.h Hammer can't use atomic so use atomic_t instead commit e8e7664247c7112f1ba03ce4cab915fe70ea5b8e Author: David Zafman Date: Fri Mar 4 18:43:43 2016 -0800 common/TrackedOp: Missed locking when examining "events" Another crash caused by a dump_ops_in_flight similar to #8885 Signed-off-by: David Zafman (cherry picked from commit be098c83143226e502a0587c9215cff941dbace1) Conflicts: src/common/TrackedOp.h (trivial) commit ce58688537d41e0662949f34b3595459581e74fc Author: David Zafman Date: Mon Jul 11 17:58:22 2016 -0700 CLEANUP: Move locking into dump_ops_in_flight()/dump_historic_ops() Signed-off-by: David Zafman (cherry picked from commit 17c645f70708134f50374cadb5505b0babe2265a) Conflicts: src/mds/MDSRank.cc (variation of code exists in mds/MDS.cc) src/mon/Monitor.cc (no equivalent code here) commit 5717eb001c6202837fe2e22039e3f855ea4aa065 Author: David Zafman Date: Mon Mar 14 15:47:02 2016 -0700 mds, osd: Fix missing locking for "dump_blocked_ops" Signed-off-by: David Zafman (cherry picked from commit be5bed840f21da998be3b8374a8e33f208258e1b) Conflicts: src/mds/MDSRank.cc (missing dump_blocked_ops in mds) commit 6a7fbf42fdb253b7143cb9b3933990145358e06c Author: David Zafman Date: Thu Mar 10 21:29:13 2016 -0800 osd: cleanup: Specify both template types for create_request() Code consistency Signed-off-by: David Zafman (cherry picked from commit cecdc49e6d2f38d5eb9f85218484f7a02bd2e1b7) commit 3e00ee5cfb0769e9b1c0e0a7540d0b14be880fed Author: Jianpeng Ma Date: Fri Jul 17 10:44:06 2015 +0800 osd: add dump_blocked_ops asok command. From ceph health we can see there are blocked ops and from 'ceph health detai' we can see which osd has blocked ops. Later we only in log of osd to see the detail message of blocked ops. Now via asok dump blocked ops. Signed-off-by: Jianpeng Ma (cherry picked from commit cf4e8c655c4a0e6c367c88338cd6e51a3474fa2f) Conflicts: src/common/TrackedOp.h (trivial) commit 656d0c9f307c1b3db072282be46decd72bc88810 Author: Jianpeng Ma Date: Wed Jul 8 13:12:49 2015 +0800 common/TrackedOp: Should lock ops_history_lock when access shutdown. Signed-off-by: Jianpeng Ma (cherry picked from commit 7fe72a2e7d116093ccff6683666e6289f5f12421) commit 9bf08ddc9422484f5cf0f05c8ccdb4b440e9b641 Merge: 9655228 2581953 Author: Nathan Cutler Date: Wed Nov 23 22:50:58 2016 +0100 Merge pull request #9873 from odivlad/fix-init-el7-hammer hammer: build/ops: remove SYSTEMD_RUN from initscript Reviewed-by: Orit Wasserman Reviewed-by: Nathan Cutler commit 9655228d1900d56f4b439d41b2c4a532158f6c51 Merge: e2c3e21 cb9cc4e Author: Nathan Cutler Date: Wed Nov 23 22:49:29 2016 +0100 Merge pull request #10238 from aiicore/hammer hammer: mon: fix memory leak in prepare_beacon Reviewed-by: Kefu Chai Reviewed-by: John Spray commit e2c3e21aa4cae160c0136d8d1652b7e4a2c000f0 Merge: 637d348 c5639e4 Author: Nathan Cutler Date: Wed Nov 23 22:44:19 2016 +0100 Merge pull request #10569 from jschmid1/wip-16918-hammer hammer: build/ops: make stop.sh more portable Reviewed-by: Nathan Cutler commit 637d348a98676cc9bf13346d96e7f83219e914c2 Merge: 84df525 2b87a55 Author: Nathan Cutler Date: Wed Nov 23 22:40:28 2016 +0100 Merge pull request #10724 from Vicente-Cheng/wip-16584-hammer hammer: crush: reset bucket->h.items[i] when removing tree item Reviewed-by: Kefu Chai commit 84df525e60ea66a4a1808641a12eccd95e16dd2d Merge: a7c8c51 8568e57 Author: Nathan Cutler Date: Wed Nov 23 22:20:29 2016 +0100 Merge pull request #10904 from tchaikov/wip-14470-hammer hammer: mon: return size_t from MonitorDBStore::Transaction::size() Reviewed-by: Joao Eduardo Luis Reviewed-by: Kefu Chai commit a7c8c511ed061102e1b91858ca9772743d7e094e Merge: c8f54c8 a3ba985 Author: Nathan Cutler Date: Wed Nov 23 22:18:42 2016 +0100 Merge pull request #10905 from SUSE/wip-11101-hammer hammer: build/ops: improve ceph.in error message Reviewed-by: Sage Weil commit c8f54c84c33354ca27d277a25a2193a3fbd80880 Merge: 48b6054 6c0b2b4 Author: Nathan Cutler Date: Wed Nov 23 22:16:48 2016 +0100 Merge pull request #10987 from Vicente-Cheng/wip-16592-hammer hammer: librbd: ceph 10.2.2 rbd status on image format 2 returns "(2) No such file or directory" Reviewed-by: Jason Dillaman commit 48b6054adf4a2d0c58a87bb2a9e8e8719febdc10 Merge: a97c81c 10472f0 Author: Nathan Cutler Date: Wed Nov 23 22:13:05 2016 +0100 Merge pull request #11125 from tchaikov/wip-17179-hammer hammer: tools: add a tool to rebuild mon store from OSD Reviewed-by: Nathan Cutler commit a97c81c3f00abbb79cef0ae069a6f151a089e30e Merge: c4cee49 4a36933 Author: Nathan Cutler Date: Wed Nov 23 22:10:54 2016 +0100 Merge pull request #11273 from aiicore/wip-17403-hammer hammer: mon: OSDMonitor: Missing nearfull flag set Reviewed-by: Sage Weil commit c4cee499622c3c151dcb363193af21844a2f24f5 Merge: 9495584 ece0ec6 Author: Nathan Cutler Date: Wed Nov 23 22:06:32 2016 +0100 Merge pull request #11618 from asheplyakov/hammer-16546 hammer: rbd: fix possible rbd data corruption Reviewed-by: Jason Dillaman commit 949558462317e16e1f517bda3ce3465fe30b931b Merge: 1fda4a0 5fb8fb4 Author: Nathan Cutler Date: Wed Nov 23 21:56:22 2016 +0100 Merge pull request #11676 from asheplyakov/hammer-16151 hammer: osd: update PGPool to detect map gaps and reset cached_removed_snaps Reviewed-by: Samuel Just commit 1fda4a0fcfe6a9d8f96fe0e054c5b9e8a6e2ecd8 Merge: 11886bd 31c2594 Author: Nathan Cutler Date: Wed Nov 23 21:54:39 2016 +0100 Merge pull request #11899 from SUSE/wip-17840-hammer hammer: rgw: the value of total_time is wrong in the result of 'radosgw-admin log show' opt Reviewed-by: Orit Wasserman commit 11886bd5d20c8b2bf09dbabda1e49f14d2283260 Merge: 21dc0ec f99a1d3 Author: Nathan Cutler Date: Wed Nov 23 21:53:40 2016 +0100 Merge pull request #11927 from SUSE/wip-17764-hammer hammer: osd: fix collection_list shadow return value Reviewed-by: Haomai Wang Reviewed-by: Samuel Just commit 21dc0ec953adeeabe934cd1090f959db7d11cefc Merge: 8f19eca 5711e79 Author: Nathan Cutler Date: Wed Nov 23 21:50:04 2016 +0100 Merge pull request #12071 from SUSE/wip-17957-hammer hammer: RWLock.h: 124: FAILED assert(r == 0) in rados-jewel-distro-basic-smithi Reviewed-by: Samuel Just commit 8f19eca51863ca1c1dfde068479bca5606e4550d Merge: af6e208 76eed80 Author: Nathan Cutler Date: Wed Nov 23 21:47:24 2016 +0100 Merge pull request #11929 from SUSE/wip-17359-hammer hammer: tools: ceph-objectstore-tool crashes if --journal-path Reviewed-by: Kefu Chai commit af6e2080f1ca56f1715ccb76d2372f86bdc272e9 Merge: 655e904 fbf51ba Author: Nathan Cutler Date: Wed Nov 23 21:46:08 2016 +0100 Merge pull request #11930 from SUSE/wip-17346-hammer hammer: cephx: Fix multiple segfaults due to attempts to encrypt or decrypt Reviewed-by: Brad Hubbard Reviewed-by: Kefu Chai commit 655e904142c295ef66c376a3aca148cf2bce60c0 Merge: c118c0a 7ad7de6 Author: Nathan Cutler Date: Wed Nov 23 21:44:39 2016 +0100 Merge pull request #11931 from SUSE/wip-17333-hammer hammer: tools: crushtool --compile generates output despite missing item Reviewed-by: Kefu Chai commit c118c0af9da259330f5e5c3f3babdfca647a566b Merge: e4ea945 ad42da4 Author: Nathan Cutler Date: Wed Nov 23 21:43:19 2016 +0100 Merge pull request #11932 from SUSE/wip-17146-hammer hammer: PG::choose_acting valgrind error or ./common/hobject.h: 182: FAILED assert(!max || (*this == hobject_t(hobject_t::get_max()))) Reviewed-by: Samuel Just commit e4ea9452cf78e01413714b597f49d32d1d11a6dd Merge: 92e0a47 e302e63 Author: Nathan Cutler Date: Wed Nov 23 21:42:24 2016 +0100 Merge pull request #11933 from SUSE/wip-17142-hammer hammer: osd: PG::_update_calc_stats wrong for CRUSH_ITEM_NONE up set items Reviewed-by: Samuel Just commit 92e0a471adffff1fa2027714116b3d0b5120b6bb Merge: d7fc569 64eeb8d Author: Nathan Cutler Date: Wed Nov 23 21:40:47 2016 +0100 Merge pull request #11934 from SUSE/wip-17120-hammer hammer: mon: %USED of ceph df is wrong Reviewed-by: Kefu Chai commit d7fc569f70b98cf2fa5a842c753f43adc801cdf7 Merge: 8a15ac7 fc46591 Author: Nathan Cutler Date: Wed Nov 23 21:39:12 2016 +0100 Merge pull request #11935 from SUSE/wip-16870-hammer hammer: osd: crash on EIO during deep-scrubbing Reviewed-by: Samuel Just commit 8a15ac77c39cc3cc571c62bab68d327894f2db7a Merge: 44588f2 4c780bd Author: Nathan Cutler Date: Wed Nov 23 21:33:27 2016 +0100 Merge pull request #11937 from SUSE/wip-16428-hammer hammer: mon: prepare_pgtemp needs to only update up_thru if newer than the existing one Reviewed-by: Samuel Just commit 44588f2755429e65960eebf51b21ddb14f245bb8 Merge: 8c90170 a56b93f Author: Nathan Cutler Date: Wed Nov 23 21:31:15 2016 +0100 Merge pull request #11938 from SUSE/wip-14323-hammer hammer: msg: OpTracker needs to release the message throttle in _unregistered Reviewed-by: Samuel Just commit 8c90170685fa74fa338b4f22b349e62a01920220 Merge: 49964b0 2332cf2 Author: Nathan Cutler Date: Wed Nov 23 21:29:45 2016 +0100 Merge pull request #11939 from SUSE/wip-13927-hammer hammer: mds: fix cephfs-java ftruncate unit test failure Reviewed-by: John Spray commit 0d2f431b2ecad03a6cda6ffbc9f9cbaac0956af9 Author: Yuan Zhou Date: Mon Jul 20 15:37:09 2015 +0800 rgw: doc: Mark S3 object version API as supported S3 object version is already in since Hammer. Ref: http://marc.info/?l=ceph-devel&m=143715290627682 Signed-off-by: Yuan Zhou (cherry picked from commit b62c3b9537e8ab33416a7fb0dd7b801a790d42ee) commit 8ca16052138bebe9f009104e62b147750dd6584d Author: shawn Date: Thu Jul 30 10:09:12 2015 +0800 doc: add bucket object version description. bucket object version has been supported, but do not have description in the docs, so add this part. Signed-off-by: shawn chen (cherry picked from commit 5c395ff85627f0f4154af27aff03dd0a9c409fb4) commit 49964b01508c5f2f9b5edd620051c18fbea7dfd7 Merge: 6e1ae86 d91c62d Author: Nathan Cutler Date: Wed Nov 23 10:52:43 2016 +0100 Merge pull request #11946 from SUSE/wip-17883-hammer hammer: mon: OSDs marked OUT wrongly after monitor failover Reviewed-by: Kefu Chai commit 6e1ae86e88661ce9de5aefb38390b4bfbc677a0a Merge: 2f9869c ab0786d Author: Nathan Cutler Date: Wed Nov 23 10:51:51 2016 +0100 Merge pull request #11948 from SUSE/wip-17671-hammer hammer: rbd: export diff should open image as read-only Reviewed-by: Mykola Golub Reviewed-by: Jason Dillaman commit 2f9869c1be5e03ca1d9daac9c541cfb226b2ae77 Merge: 2dac884 815541f Author: Nathan Cutler Date: Wed Nov 23 10:48:06 2016 +0100 Merge pull request #11949 from SUSE/wip-17374-hammer hammer: librbd: image.stat() call in librbdpy fails sometimes Reviewed-by: Jason Dillaman commit 2dac8848e94b9dcf1a217c6c70164edf669a8eee Merge: 1503c2b da653fc Author: Nathan Cutler Date: Wed Nov 23 10:41:03 2016 +0100 Merge pull request #11950 from SUSE/wip-17123-hammer hammer: rgw: COPY broke multipart files uploaded under dumpling Reviewed-by: Orit Wasserman commit 1503c2ba753b8ee31e7c632d0463691a83a22b8b Merge: 118beb9 009c844 Author: Nathan Cutler Date: Wed Nov 23 10:39:46 2016 +0100 Merge pull request #11951 from SUSE/wip-16594-hammer hammer: rgw: swift: ranged request on a DLO provides wrong values in Content-Range HTTP header Reviewed-by: Orit Wasserman commit 118beb9a390bf481e520d6888453eecc805bb0d7 Merge: 3b226b8 3404da8 Author: Nathan Cutler Date: Wed Nov 23 10:17:00 2016 +0100 Merge pull request #11952 from SUSE/wip-16318-hammer hammer: rgw: fix inconsistent uid/email handling in radosgw-admin Reviewed-by: Orit Wasserman commit 3b226b8282f1c994cf3fbb747131121ec9b0c7a0 Merge: 9ad7369 d89b1f8 Author: Nathan Cutler Date: Wed Nov 23 10:14:10 2016 +0100 Merge pull request #12018 from trociny/wip-17068-hammer hammer: librbd: request exclusive lock if current owner cannot execute op Reviewed-by: Jason Dillaman commit 9ad73698f57598ae1302aaf175cb96082eb64961 Merge: 3ca7317 a7b182e Author: Nathan Cutler Date: Wed Nov 23 06:42:06 2016 +0100 Merge pull request #11045 from SUSE/wip-17150-hammer hammer: rgw: Anonymous user is able to read bucket with authenticated read ACL Reviewed-by: Orit Wasserman commit 3ca73177fc28327960f0a8c1612de0358051d515 Merge: 708c549 d50a501 Author: Nathan Cutler Date: Wed Nov 23 06:32:09 2016 +0100 Merge pull request #11809 from SUSE/wip-17631-hammer hammer: rgw: fix crash when client posts object with null condition Reviewed-by: Orit Wasserman commit 10472f0521f6aef516660a470be8c5fe453b1a76 Author: Kefu Chai Date: Tue Nov 22 11:53:57 2016 +0800 PendingReleaseNotes: document the feature to rebuild monstore Signed-off-by: Kefu Chai commit 9473135aa65282499f67847edb52b7dfd8b374fb Author: Kefu Chai Date: Mon Oct 10 18:43:39 2016 +0800 doc: fill keyring with caps before passing it to ceph-monstore-tool to make sure the recovered monitor store is ready for use. Signed-off-by: Kefu Chai (cherry picked from commit af8e21163735377071b6832d8a81b035bb835257) commit 9c00ba17627c2b3526c558564954b8bb1d8472ef Author: Kefu Chai Date: Mon Oct 10 16:32:27 2016 +0800 tools/ceph_monstore_tool: bail out if no caps found for a key we take it as an error if no caps is granted to an entity in the specified keyring file when rebuilding the monitor db. Signed-off-by: Kefu Chai (cherry picked from commit b4bd4004a836121c11b0bb97d8123df54c271f04) commit 48696e9d6d89f6b6e99fb76ffa61665c026d7a0e Author: Kefu Chai Date: Fri Sep 30 17:58:14 2016 +0800 tools/ceph_monstore_tool: update pgmap_meta also when rebuilding store.db we should rebuild pgmap_meta table from the collected osdmaps Fixes: http://tracker.ceph.com/issues/17400 Signed-off-by: Kefu Chai (cherry picked from commit cdfa7a69f63d047205dcfccd63b5d58ab0d4695b) Conflicts: src/tools/ceph_monstore_tool.cc: remove C++11-ism commit ca67e8e88c06a9a37e5dc9e8fe5a1dd1821f8452 Author: xie xingguo Date: Sun Sep 18 11:40:56 2016 +0800 tools/rebuild_mondb: kill compiling warning As follow: [ 72%] Building CXX object src/tools/CMakeFiles/ceph-objectstore-tool.dir/RadosDump.cc.o /home/jenkins-build/build/workspace/ceph-pull-requests/src/tools/rebuild_mondb.cc: In function ‘int update_mon_db(ObjectStore&, OSDSuperblock&, const string&, const string&)’: /home/jenkins-build/build/workspace/ceph-pull-requests/src/tools/rebuild_mondb.cc:289:22: warning: ‘crc’ may be used uninitialized in this function [-Wmaybe-uninitialized] if (have_crc && osdmap.get_crc() != crc) { ^ /home/jenkins-build/build/workspace/ceph-pull-requests/src/tools/rebuild_mondb.cc:238:14: note: ‘crc’ was declared here uint32_t crc; Signed-off-by: xie xingguo (cherry picked from commit f16a31476a3f9b44a7c3dabf0dfd2a0d015b11b9) commit 94390a3296483323d1b2c57856ea2e8ecca99b64 Author: xie xingguo Date: Sun Sep 18 10:43:10 2016 +0800 tools/rebuild_mondb: return error if ondisk version of pg_info is incompatible In this case "r" will be >= 0 and caller will be able to catch this kind of error. Signed-off-by: xie xingguo (cherry picked from commit ac7c1dca0a4f6e92e50d362784122e2d3200e6b5) commit eaeb52057509b1fa45592ecc147ad694f57d33f3 Author: xie xingguo Date: Sun Sep 18 10:33:56 2016 +0800 tools/rebuild_mondb: avoid unnecessary result code cast In general we return negative codes for error cases, so there is no need perform the cast here. Signed-off-by: xie xingguo (cherry picked from commit 6a1c01d334fe65124043aa68a6e0cfaea43836b5) commit 828a4d7a07d178f2dcde30dfe96ca9f054bc1c0d Author: Kefu Chai Date: Wed Aug 31 00:59:58 2016 +0800 doc: add rados/operations/disaster-recovery.rst document the process to recover from leveldb corruption. Fixes: http://tracker.ceph.com/issues/17179 Signed-off-by: Kefu Chai (cherry picked from commit 79a9f299253e24d20547131b3c9c9e0667e3b869) commit 3ef5dcd2b37055994794f9cf6139dc2d8807d637 Author: Kefu Chai Date: Mon Aug 29 19:53:11 2016 +0800 tools/ceph_monstore_tool: add "rebuild" command Fixes: http://tracker.ceph.com/issues/17179 Signed-off-by: Kefu Chai (cherry picked from commit d909fa035c8fbbded786b2ca072acc10ea6b6052) Conflicts: ceph_monstore_tool.cc: remove C++11ish commit 6695d1792df9ca7cf5afd5a8c25a04f1eb9ff0fa Author: Kefu Chai Date: Mon Aug 29 19:52:19 2016 +0800 tools/ceph-objectstore-tool: add "update-mon-db" command Fixes: http://tracker.ceph.com/issues/17179 Signed-off-by: Kefu Chai (cherry picked from commit 24faea7ce446bbf09cbd4a9d3434dd5444a6c295) Conflicts: src/tools/Makefile-server.am: add rebuild_mondb.{cc,h}, as autotools support is dropped in master ceph_objectstore_tool.cc, rebuild_mondb.cc: remove C++11ish adapt to hammer commit e7d9c15871efcd17b9b1064a5ee49edfe4a159e9 Author: Kefu Chai Date: Wed Aug 31 13:11:24 2016 +0800 mon/AuthMonitor: make AuthMonitor::IncType public so ceph-objectstore-tool is able to use it when rebuilding monitor db. Fixes: http://tracker.ceph.com/issues/17179 Signed-off-by: Kefu Chai (cherry picked from commit 19ef4f16b3aba04119ac647cd6261c74a57ce829) commit 107e9c358acbc75f212f0bc6fcf83075933035b3 Author: David Zafman Date: Tue Mar 15 11:29:17 2016 -0700 thrasher: Add dump_ops_enable options Add dump_ops_enable which continuously dumps ops using 3 commands Signed-off-by: David Zafman (Partial cherry picked from commit 7a528763d126eaca90e40b02aad02ab9c3c92a32) Excluded dynamic optracker testing with optrack_toggle_delay option Conflicts: tasks/ceph_manager.py (trivial) tasks/thrashosds.py (trivial) commit b7c87ae74a7f3f3c0096fe6cfe36e1077f96ea1f Author: David Zafman Date: Tue Apr 12 09:27:33 2016 -0700 ceph_manager: Add timeout to admin_socket/osd_admin_socket Signed-off-by: David Zafman (cherry picked from commit 4ad3b866041a3a5391f46cd3d96297834b95956b) commit f79027a229b2cbb16eaf877b06bf35ecff647bea Author: Kefu Chai Date: Wed Feb 25 16:10:51 2015 +0800 Thrasher: log backtrace of thrown exception * add a wrapper to log uncaught exception to self.logger, greenlet also prints the backtrace and exception to stderr, but teuthology.log does not capture stderr. so we need to catch them by ourselves to reveal more info to root-cause this issue. * log uncaught exception thrown by Thrasher.do_thrash() to self.log. See: #10630 Signed-off-by: Kefu Chai (cherry picked from commit 64de3cd574b200d90cb3aea0d646a6236d8fec5e) commit 4533623b3df1e48b821a509013a91e8c3a7ec4a0 Author: Sage Weil Date: Mon Nov 21 16:58:48 2016 -0500 rados: remove btrfs tests; use xfs instead Signed-off-by: Sage Weil commit fb7f49658815d5427f6454b20560991a785a8399 Author: Zhiqiang Wang Date: Mon Mar 30 15:25:34 2015 +0800 common/TrackedOp: checking in flight ops fix Return earlier if tracking is not enabled when checking in flight ops. Signed-off-by: Zhiqiang Wang (cherry picked from commit 7509a6caa4964d71625c43f2ddc10e6274b6a21b) commit b58873efafabdc9791f500cff77be9a0a7002227 Author: Zhiqiang Wang Date: Mon Mar 30 14:41:21 2015 +0800 common/OpTracker: don't dump ops if tracking is not enabled If tracking is disabled, there is nothing to dump. No need to go through each sharded list. This is true for both in flight and historical ops. Signed-off-by: Zhiqiang Wang (cherry picked from commit ec3c40952bbc4b495875e08b57d764a7487c6c09) commit 24c92fea4bc68a27a240155f48ee5fa4ee3bbfa0 Author: Jianpeng Ma Date: Mon Jul 6 13:49:42 2015 +0800 common/TrackedOp: check tracking_enabled for event "initiated/done". Signed-off-by: Jianpeng Ma (cherry picked from commit d7585c020de41f25e6a598661844169f2bdbb2b4) commit 0f37a397e35f105b5ea57c7a1a0463c95a2384e1 Author: Jianpeng Ma Date: Mon Jul 6 10:48:36 2015 +0800 common/TrackedOp: clean up code make look good. Signed-off-by: Jianpeng Ma (cherry picked from commit edefd05edce6728774bb396ea4e6641ea53463cd) commit ece0ec60154d22bca7002cc308f3a0f4e36a053e Author: Greg Farnum Date: Mon May 23 15:14:21 2016 -0700 hammer: ObjectCacher: fix bh_read_finish offset logic If we have an incoming read split across multiple BufferHeads, we want to line up the BufferHead's bl with the incoming OSDOp's bl at the right offset. We were erroneously using this nonsense calculation (always equal to zero!) when a much simpler comparison of the BufferHead's logical object offset to the incoming OSDOp's logical offset will do the trick nicely. Fixes: http://tracker.ceph.com/issues/16002 Signed-off-by: Greg Farnum (cherry picked from commit 9ec6e7f608608088d51e449c9d375844631dcdde) commit 33f277e601199003fc226c84f67d1bbebb36ad2c Author: Greg Farnum Date: Fri Jun 10 17:01:09 2016 -0700 hammer: test: build a correctness test for the ObjectCacher For now it's very specifically designed to reproduce http://tracker.ceph.com/issues/16002, but it can be extended to other patterns in the future. Signed-off-by: Greg Farnum (cherry picked from commit 0fd55a9886dd8da344c23a5e9898ee5c5061e8f9) Hammer specific changes: * use utime_t instead of ceph::real_time * ObjectCacher::prepare_write() has no journal_tid argument * rewrite the code in C++98 commit 439ce945dde196a4439e4468681e35eadd4fca5f Author: Greg Farnum Date: Tue May 31 16:18:19 2016 -0700 hammer: test: split objectcacher test into 'stress' and 'correctness' Signed-off-by: Greg Farnum (cherry picked from commit cc9aab1b0a22c3f7320046b97f75dccf2b86cc6d) commit ff3635a5457ac89ea0fb02f40f0ca723fe34e87c Author: Greg Farnum Date: Thu Jun 23 13:41:46 2016 -0700 hammer: test: add a data-storing MemWriteback for testing ObjectCacher Signed-off-by: Greg Farnum (cherry picked from commit ed5801492bf2850e80a328ce5a61cb1ff2709215) Hammer specific changes: * use utime_t instead of ceph::real_time * ObjectCacher::prepare_write() has no journal_tid argument * rewrite code in C++98 commit 7a2abfac759acaf668c6ace25df94619f27e829d Author: Yan, Zheng Date: Wed Oct 28 17:06:59 2015 +0800 hammer: objectcacher: introduce ObjectCacher::flush_all() Signed-off-by: Yan, Zheng (cherry picked from commit bd86c301a54a6e23cf2ce257b8024b6b92dfbe11) Conflicts: src/osdc/ObjectCacher.h - whitespace only changes Semantic conflicts: ObjectCacher::flush_all(): dirty_or_tx_bh is a set in Hammer commit 9df96606edfb9ff9932297b8253a297cf75c02f6 Author: Greg Farnum Date: Thu Jun 23 14:23:51 2016 -0700 hammer: osd: provide some contents on ObjectExtent usage in testing Signed-off-by: Greg Farnum (cherry picked from commit a555d9a0c7d3b6c2206520cf78445234b0834639) commit c5639e4e276a8d5f6457ce9f63b3e77a230a669c Author: Mykola Golub Date: Mon Dec 14 09:41:10 2015 +0000 stop.sh: make more portable Signed-off-by: Mykola Golub (cherry picked from commit 27f2d806f905df1a51b11bd79f1af4c26471407a) commit 708c549b8d77b9a9ea4d46640287848a74898a40 Merge: f776699 0ac7f2f Author: Sage Weil Date: Mon Nov 21 09:03:44 2016 -0600 Merge pull request #12006 from SUSE/wip-17905-hammer hammer: mon: MonmapMonitor should return success when MON will be removed Reviewed-by: Sage Weil commit d1e1207275eeaf2409b435236c579116900eb6b7 Author: Ning Yao Date: Thu Oct 13 16:53:18 2016 +0800 FileStore:: fix fiemap issue in xfs when #extents > 1364 Fixes: #17610 Backport: jewel, hammer Signed-off-by: Ning Yao (cherry picked from commit 1a1c126d80b427d5230347fbc71a4edea5c0b6c8) Conflicts: src/os/FileStore.cc in hammer, there is no _do_seek_hole_data() function so remove it in hammer, the logic is in FileStore::fiemap not in _do_fiemap() so port the logic to the else branch in FileStore::fiemap commit a3ba985c38c07f85056f90d125e32ea277c65932 Author: Kefu Chai Date: Tue Jan 5 15:00:59 2016 +0800 ceph.in: improve the error message Fixes: #11101 Signed-off-by: Kefu Chai (cherry picked from commit e19e8f1553fdf8b6b642d3222d28f242fab696f0) commit 5711e794218cc83db023e1d6600ed75ef3ac3fcc Author: Sage Weil Date: Tue Mar 29 15:24:34 2016 -0400 os/ObjectStore: fix _update_op for split dest_cid Signed-off-by: Sage Weil (cherry picked from commit e3dc7c772f563f97bc68ebc6dc6e0d408e7c11f3) commit cb9cc4e57a2abd5c13f61599a7fe594c5f21c9c3 Author: Igor Podoski Date: Mon Jul 11 12:37:25 2016 +0200 mon/MDSMonitor: fix memory leak in prepare_beacon prepare_beacon() case of prepare_update() should put() message in two more cases, because is the last step of dispatch() Fixes: http://tracker.ceph.com/issues/17285 Signed-off-by: Igor Podoski commit 4a36933df8b9338c0a32d582e005894442092d0f Author: Igor Podoski Date: Wed Sep 14 07:36:43 2016 -0400 mon: OSDMonitor: Missing nearfull flag set Output from 'ceph -s -f json-pretty' wans't showing nearfull flag set. Signed-off-by: Igor Podoski (cherry picked from commit 754887b575795ef96cda095f7f0d8c898e20f00f) commit e1694d6e85694ee8750b2af211505b89b3d6f0c8 Author: Kefu Chai Date: Thu Oct 13 13:19:27 2016 +0800 mon: send updated monmap to its subscribers prior to this change, we sends monmap when serving the subscription requests, but the updates are not sent to the subscribers anymore. so we need to send latest monmap to subscribes and update the subscription status accordingly when the monmap is updated. http://tracker.ceph.com/issues/17558 Signed-off-by: Kefu Chai (cherry picked from commit c2b348b12c47ba505f72228ae0ea9b1a1b674719) Conflicts: src/mon/Monitor.cc: resolve conflicts src/mon/MonmapMonitor.cc: remove C++11-ism commit ab0786d6a023e391e61119bd309985dcf6e05a4d Author: YankunLi Date: Tue Sep 6 16:16:58 2016 +0800 rbd: this command should be EXPORT_DIFF Fixes: http://tracker.ceph.com/issues/17671 Signed-off-by: liyankun commit d91c62dcf5b1c98b4cfed4eebf29ff9a9d64289b Author: Dong Wu Date: Thu Oct 27 11:02:36 2016 +0800 mon: update mon(peon)'s down_pending_out when osd up Fixes: http://tracker.ceph.com/issues/17719 Signed-off-by: Dong Wu (cherry picked from commit 664254a17afbad86983ea5b5b8d385662d89e65e) Conflicts: src/mon/OSDMonitor.cc (auto declaration for variable "found" is a C++11ism, replace with the full verbose C++98 type) commit d89b1f848b8c942d150076cef99491e4c5031bda Author: Mykola Golub Date: Wed Nov 16 12:01:00 2016 +0200 librbd: request exclusive lock if current owner cannot execute op This is a direct commit to hammer due to librbd code has evolved significantly in the master. Fixes: http://tracker.ceph.com/issues/17068 Signed-off-by: Mykola Golub commit 2b87a551c603291d6c018ed72b0c58e8e45bc334 Author: Kefu Chai Date: Fri Jul 1 20:44:35 2016 +0800 crush: reset bucket->h.items[i] when removing tree item * crush: so we don't see the reference after the removing, this keeps check_item_loc() happy, and move_bucket() use check_item_loc() to see if the removed bucket disappears after the removal. * test: also add unittest_crush_wrapper::CrushWrapper.insert_item Fixes: http://tracker.ceph.com/issues/16525 Signed-off-by: Kefu Chai (cherry picked from commit a7069c7aab6b3f605f3d8f909af96f87977e8698) Backport change: modify some codes that only works on c++ 11 commit 0ac7f2f6c87e0d454466927b8528b3f3dae812a2 Author: Joao Eduardo Luis Date: Wed Nov 2 15:33:52 2016 +0000 mon: MonmapMonitor: return success when monitor will be removed Fixes: http://tracker.ceph.com/issues/17725 Signed-off-by: Joao Eduardo Luis (cherry picked from commit c9d46cfbf2512bc3495c6901de2b8f711bef9bae) Conflicts: src/mon/MonmapMonitor.cc (just inserted the "err = 0" assignment immediately after the error message line) commit 6c0b2b4ceba188397d5877a602b0e1996d29a4eb Author: Jason Dillaman Date: Thu Aug 4 20:40:10 2016 -0400 librbd: prevent creation of v2 image ids that are too large The librbd API is capped at 24 characters for expressing the object prefix for data blocks (including trailing null byte). Fixes: http://tracker.ceph.com/issues/16887 Signed-off-by: Jason Dillaman (cherry picked from commit 4de7c8d0a7222c83268d03b99015c6b9d25f124d) commit 5fb8fb4e450949ebc4c724c102a5b2ae6f1d06c8 Author: Samuel Just Date: Thu May 19 16:00:35 2016 -0700 PG: update PGPool to detect map gaps and reset cached_removed_snaps Fixes: http://tracker.ceph.com/issues/15943 Signed-off-by: Samuel Just (cherry picked from commit 5798fb3bf6d726d14a9c5cb99dc5902eba5b878a) Conflicts: src/osd/OSD.cc: trivial, fuzz is too big so git prefers to be safe commit 3404da8f1e491df86c8a1f12606546cd5a7d952c Author: Matt Benjamin Date: Mon Jan 18 15:58:07 2016 -0500 rgw-admin: return error on email address conflict (add user) Fixes the error return inconsistency documented in upstream Ceph issue #13598 Revised after upstream review, permits changing email address as originally (but use case-insensitive comp). Signed-off-by: Matt Benjamin (cherry picked from commit 90c143efa2156e55dc017ebe81005315cacaf2c5) Conflicts: src/rgw/rgw_user.cc (there is no op_state.found_by_email conditional in hammer) commit f5bf5c0f9e9db788fd556f9e92f805fc215138f6 Author: Matt Benjamin Date: Mon Jan 18 15:06:19 2016 -0500 rgw-admin: convert user email addresses to lower case Fixes the email address inconsistency documented in upstream Ceph BUG #13598 Signed-off-by: Matt Benjamin (cherry picked from commit 4c438dbbc0e6eda6b9a3018d60019a1a780d6f65) commit 009c844e34bcd3e4e34eace90f90a140484e2794 Author: Radoslaw Zarzynski Date: Mon Oct 12 18:43:27 2015 +0200 rgw: fix wrong length in Content-Range HTTP header of Swift's DLO. Fixes: #13452 Signed-off-by: Radoslaw Zarzynski (cherry picked from commit b48f3d774129e0b37531fccda513626bd8ef07e5) commit 2175b688358455472ac6320bb82ac6bef7133e59 Author: Radoslaw Zarzynski Date: Mon Oct 12 17:32:21 2015 +0200 rgw: fix wrong first byte pos in Content-Range HTTP header of Swift's DLO. Fixes: #13452 Signed-off-by: Radoslaw Zarzynski (cherry picked from commit 66f47f35bbb4966cb289811672938b90ae6d44ae) commit da653fc3594d49bdac5dc00129c8aa5fd227d6c0 Author: Yehuda Sadeh Date: Thu Jul 7 18:01:54 2016 -0700 rgw: adjust manifest head object adjust the manifest head object: - when reading manifest, set the head object to the object we read the manifest from (and its size). Some manifests are broken and point at a different object - when copying multipart object, set the manifest head object to point at the new head object Signed-off-by: Yehuda Sadeh (cherry picked from commit 419264586fc46337322f0d60b0ffcdcce3bb5c5a) commit 8f1c915fa47a889cb50cf84e2d1230df7443752c Author: Yehuda Sadeh Date: Thu Jul 7 15:49:07 2016 -0700 rgw: adjust objs when copying obj with explicit_objs set If the head object contains data, need to set it in the list of objs (in addition to being pointed at by head_obj). Signed-off-by: Yehuda Sadeh (cherry picked from commit 1e012112b99004745952accc6fb11ada5e8e0045) commit 43a5d5eb2835e1750ef4fbe6d8d3d85af02c6b30 Author: Yehuda Sadeh Date: Thu Jul 7 15:36:33 2016 -0700 rgw: patch manifest to handle explicit objs copy issue Fixes: http://tracker.ceph.com/issues/16435 Signed-off-by: Yehuda Sadeh (cherry picked from commit b51476466e5bb03bbaa6e428bb6bb189a259b9fd) commit 815541feb989442bdf4d30faf603ef2795bc1ade Author: Jason Dillaman Date: Tue Sep 20 07:25:36 2016 -0400 librbd: block name prefix might overflow fixed size C-string The issue which resulted in too large v2 image ids was fixed under #16887. Fixes: http://tracker.ceph.com/issues/17310 Signed-off-by: Jason Dillaman (cherry picked from commit 61734d266c6ee476c2f5fcfbbaefc7d0c7939617) commit a56b93faf2ae8db2ebe55aaf6003a48ac2bfb8b2 Author: Samuel Just Date: Tue Jan 5 16:24:15 2016 -0800 OpRequest: release the message throttle when unregistered We don't want messages in the OpTracker history hanging on to message throttle. Fixes: #14248 Backport: hammer, firefly Signed-off-by: Samuel Just (cherry picked from commit 67be35cba7c384353b0b6d49284a4ead94c4152e) Conflicts: src/msg/Message.h (s/nullptr/0/ because C++98) commit 4c780bd7fc6e8a98334ddd049a4969d88a9de49f Author: Samuel Just Date: Tue Jun 7 17:15:05 2016 -0700 OSDMonitor::prepare_pgtemp: only update up_thru if newer Fixes: http://tracker.ceph.com/issues/16185 Signed-off-by: Samuel Just (cherry picked from commit 5f2bd7b6b28aad96d68444b22c04b8b24564616b) Conflicts: src/mon/OSDMonitor.cc (master uses C++11 "auto" for new_up_thru iterator, replace with explicit type) src/mon/OSDMonitor.h (trivial resolution) commit 7ad7de69631372ef364d19bf023e7dba3c88092c Author: Kefu Chai Date: Tue Sep 20 14:10:16 2016 +0800 crush/CrushCompiler: error out as long as parse fails do not output compiled crush map if anything goes wrong when parsing crush map. Fixes: http://tracker.ceph.com/issues/17306 Signed-off-by: Kefu Chai (cherry picked from commit b2c0a079dc074c907e1bc429861230096534f597) Conflicts: src/test/cli/crushtool/compile-decompile-recompile.t (hammer needs $TESTDIR/ prefix) commit 2332cf22d23fd40ae238b98798e3290094548914 Author: Yan, Zheng Date: Mon Mar 30 17:35:59 2015 +0800 mds: fix out-of-order messages When MDS is no longer laggy, it should process deferred messages first, then process newly received messages. Fix: #11258 Signed-off-by: Yan, Zheng (cherry picked from commit ccdeaf87df8b66e09f6b20950b57ac61bf213086) commit fc4659155406432404d6e7afb63de545e4abf1a6 Author: Nathan Cutler Date: Sat Nov 12 12:37:00 2016 +0100 pg: restore correct behavior of read() callers This patch is inspired by fabd6357e42e526d2704d7cb80375c12d731df8d but is not a cherry-pick. Fixes: http://tracker.ceph.com/issues/16870 Signed-off-by: Nathan Cutler commit 64eeb8d96cf295c8a3739d5d993b51f77c35e466 Author: Kefu Chai Date: Fri Aug 5 14:27:43 2016 +0800 mon/PGMonitor: calc the %USED of pool using used/(used+avail) we were using "the raw space used by this pool" / "the raw space of the whole cluster" as the %USED. but it's wrong: - there is chance that not all OSDs are assigned to the pool in question - we can not utilize all the raw space for the pool: there is overhead. and the size of available space for a pool is capped by the assigned OSD with minimal free space. so we should use USED / (USED + AVAIL) as the %USED. so once we have no AVAIL space left, %USED will be 100%. Fixes: http://tracker.ceph.com/issues/16933 Signed-off-by: Kefu Chai (cherry picked from commit 08532ea166dfd97c548d9f1fb478e163021cdda3) Conflicts: src/test/mon/CMakeLists.txt (file does not exist in hammer) commit d62258c03492fca5fca99650cc7514348251cb7b Author: Kefu Chai Date: Sun Aug 7 00:58:04 2016 +0800 mon/PGMonitor: mark dump_object_stat_sum() as static so we can test this method without create an instance of PGMonitor. Signed-off-by: Kefu Chai (cherry picked from commit af3d3e25823ca9b40ddf09835edb82795ac68f33) Conflicts: src/mon/PGMonitor.cc ("const" suffix of function definition was removed in master, but in hammer it wasn't there, so no change necessary) src/mon/PGMonitor.h (added static prefix to function declaration; did not remove "const" suffix because it wasn't there in hammer) commit e302e636b8fd8f3106a3971dfc44f2c91995e3f5 Author: Samuel Just Date: Thu Aug 11 08:57:51 2016 -0700 PG: use upset rather than up for _update_calc_stats Fixes: http://tracker.ceph.com/issues/16998 Signed-off-by: Samuel Just (cherry picked from commit 200cae8c9db99b3dede377f74413cc0b15033e1f) commit cfa2b2d3bcad8ebf0a94b89b3a27ce72445fc30a Author: Samuel Just Date: Thu Aug 11 08:57:35 2016 -0700 PG: introduce and maintain upset Signed-off-by: Samuel Just (cherry picked from commit 80a5c21d97116e7a66351a0e1f5d9b561f8663ac) commit ad42da47909f2ce6902c9f34e2e9e0c445bb1cc7 Author: Tao Chang Date: Mon May 9 09:50:17 2016 -0400 Cleanup: delete find_best_info again After called find_best_info find a auth_pg_shard, it must be not incomplete, so it will not enter find_best_info again. Signed-off-by: Tao Chang (cherry picked from commit a25cfc4d46c03d8d78e0254c728ea5c29e2246e1) Conflicts: src/osd/PG.cc (trivial resolution) commit fbf51ba878c7a00c045fc97bf309c39b0d9c4fcc Author: Brad Hubbard Date: Tue Jun 14 17:34:44 2016 +1000 cephx: Fix multiple segfaults due to attempts to encrypt or decrypt an empty secret and a null CryptoKeyHandler Fixes: http://tracker.ceph.com/issues/16266 Signed-off-by: Brad Hubbard (cherry picked from commit 009e777fbd18602e5fd66f97bdad95e977e6fecc) commit 76eed80e6649fdd53a2a3ee3d7242a8e48e1168a Author: Kefu Chai Date: Tue Sep 20 17:39:24 2016 +0800 os/filestore/FileJournal: fail out if FileJournal is not block device or regular file otherwise JournalingFileStore will assert when deleting FileJournal which still has the non block/regular file opened. Fixes: http://tracker.ceph.com/issues/17307 Signed-off-by: Kefu Chai (cherry picked from commit 7431eec6fd24cd08ca6c76a9893e3f6e8c63a916) commit f99a1d364ae8ec0f7bad220fdd6d665ecdc8029c Author: Haomai Wang Date: Sun Oct 9 18:31:54 2016 +0800 osd/PGBackend: fix collection_list shadow return value Fixes: http://tracker.ceph.com/issues/17713 Signed-off-by: Haomai Wang (cherry picked from commit 8a53a604f375eb568a6fc88a402a6afd83fa151a) Conflicts: src/osd/PGBackend.cc (master is using store->collection_list and ch; hammer is using store->collection_list_partial and coll) commit a7b182e00639e635092fa40c39073859720215af Author: root Date: Thu Sep 24 00:21:13 2015 +0530 13207: Rados Gateway: Anonymous user is able to read bucket with authenticated read ACL Signed-off-by: root (cherry picked from commit 99ba6610a8f437604cadf68cbe9969def893e870) commit 31c25941d551c61df4eabdb6c3e2226ef4b3cf02 Author: weiqiaomiao Date: Tue Oct 11 19:32:43 2016 +0800 rgw: fix the field 'total_time' of log entry in log show opt Fixes: http://tracker.ceph.com/issues/17598 Signed-off-by: weiqiaomiao (cherry picked from commit 8f4825c5f012c77a3a91e22706dcab9c6067d77e) commit d50a5018c43d200e4cd36daa7826b2b4c17434ed Author: Yehuda Sadeh Date: Thu Oct 20 10:17:36 2016 -0700 rgw: handle empty POST condition Fixes: http://tracker.ceph.com/issues/17635 Before accessing json entity, need to check that iterator is valid. If there is no entry return appropriate error code. Signed-off-by: Yehuda Sadeh (cherry picked from commit 23cb642243e09ca4a8e104f62a3bb7b2cbb6ea12) commit 258195373a6aaabe9a74805268d8094bf48fae0a Author: Vladislav Odintsov Date: Mon Jul 4 15:29:22 2016 +0300 init-radosgw: do not use systemd-run in sysvinit `systemd-run` logic in initscripts was introduced because of ticket http://tracker.ceph.com/issues/7627. If we have systemd-based operating system, we should use systemd unit files from systemd directory to start/stop ceph daemons. Otherwise, `daemon()` from `/etc/init.d/functions` on systemd distro starts service in `system.slice` and everything works well. `systemd-run` can not be run on non-systemd distros, so it's not needed on SysV systems. also, ceph-disk is now able to run the "systemctl" to enable and start the ceph-osd, and ceph-deploy is also now playing well with systemd when it comes to ceph-mon and ceph-mds Fixes: http://tracker.ceph.com/issues/16440 Signed-off-by: Vladislav Odintsov (cherry picked from commit 1fd4f92a025e80092b8d08d9b7da2e0b73a52f0f) commit f776699fd00ff5f0deea15ec4f2efb991831b055 Merge: 8e13e7c bfa7c14 Author: Loic Dachary Date: Sat Oct 29 10:24:18 2016 +0200 Merge pull request #11372 from ceph/wip-17386-hammer hammer: doc: add "Upgrading to Hammer" section Reviewed-by: Samuel Just Reviewed-by: Kefu Chai commit bfa7c14894ebab3ab58282782d8217438a3c4047 Author: Kefu Chai Date: Thu Oct 27 15:44:09 2016 +0800 doc: add "to Hammer" upgrade section Fixes: http://tracker.ceph.com/issues/17534 Signed-off-by: Kefu Chai commit 8e5872bf6c18b410136fd76974ae11e645c09928 Merge: 995d3a9 2c27626 Author: Zack Cerza Date: Wed Oct 19 11:36:07 2016 -0600 Merge pull request #1215 from jcsp/wip-generate-caps-hammer tasks/ceph: move generate_caps from teuthology commit 2c27626c1e5d9989ac6942a94b6d9198ccbd28fb Author: John Spray Date: Tue Sep 27 12:17:22 2016 +0100 tasks/ceph: move generate_caps from teuthology This was only used in this task, and it is much too ceph-specific to belong in teuthology. Fixes: http://tracker.ceph.com/issues/17614 Signed-off-by: John Spray (cherry picked from commit 298cc8f932a2a327e07f5b73708404588a611322) commit e7253b8ecb49bf894dbc21d260a767ecd8d3eb19 Author: Yehuda Sadeh Date: Mon Oct 3 16:43:44 2016 -0700 rgw_admin: add bi purge command Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc commit 4f605ebf3f415943e8c151364dadfdce3b69cde5 Author: Yehuda Sadeh Date: Wed Sep 28 12:54:47 2016 -0700 rgw: bucket resharding, adjust logging Signed-off-by: Yehuda Sadeh commit 6503430d1b47630b12164f46702bbb42dd7bb453 Author: Yehuda Sadeh Date: Wed Sep 28 10:41:45 2016 -0700 cls/rgw: bi_list() fix is_truncated returned param is_truncated was never set. Also, make sure that we don't return more entries than requested. Signed-off-by: Yehuda Sadeh commit f07e22ae7beab634068cc37a975356393c8b60bf Author: Yehuda Sadeh Date: Tue Sep 27 15:13:37 2016 -0700 rgw_admin: require --yes-i-really-mean-it for bucket reshard in the case where num shards are less or equal to current bucket Signed-off-by: Yehuda Sadeh commit 55e3e7742b22fd0f015f7439e7aeabdce1845caa Author: Yehuda Sadeh Date: Tue Sep 27 14:35:31 2016 -0700 rgw_admin: better bucket reshard logging Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc commit 75f69da3ecba55992453f0a901f997e8a1737884 Author: Yehuda Sadeh Date: Tue Sep 27 14:11:41 2016 -0700 rgw: limit bucket reshard num shards to max possible Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc src/rgw/rgw_rados.h commit b6a15514e7cad6c8fd84f589fd5e4c7b505045e7 Author: Yehuda Sadeh Date: Tue Sep 27 11:55:32 2016 -0700 rgw_admin: fix bi list command Changes scoping of json section, and push the --object param in so that an object can be specified as a filter. Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc commit 6e91760e045b61a144d669f1caa5a55e10b13e58 Author: Yehuda Sadeh Date: Mon Sep 26 15:49:37 2016 -0700 rgw_admin: use aio operations for bucket resharding also created shards manager to make things slightly cleaner Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc commit a68d56febde154b3b92d3178d2e877e86b3e2dd9 Author: Yehuda Sadeh Date: Mon Sep 26 10:45:17 2016 -0700 rgw: bucket reshard updates stats Signed-off-by: Yehuda Sadeh Conflicts: src/cls/rgw/cls_rgw_types.h src/rgw/rgw_admin.cc commit 858bcf189afb9fd042c370bb1f53864447dcdc96 Author: Yehuda Sadeh Date: Mon Sep 26 09:52:29 2016 -0700 cls/rgw: add bucket_update_stats method Signed-off-by: Yehuda Sadeh commit 37cda4ec1fee1d6e413d1ffe8c5f4f6558634740 Author: Yehuda Sadeh Date: Sat Sep 24 10:46:36 2016 -0700 rgw_admin: reshard also links to new bucket instance Signed-off-by: Yehuda Sadeh commit 6c3e734cd87138b55a8a65951d76f7f91c9f0d93 Author: Yehuda Sadeh Date: Sat Sep 24 10:33:57 2016 -0700 rgw: rgw_link_bucket, use correct bucket structure for entry point The bucket structure might be different than the one that we were using before. Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_bucket.cc commit 7cc1de860dce16e3956fe604b3bcb8ed1a2fe9ea Author: Yehuda Sadeh Date: Sat Sep 24 10:01:00 2016 -0700 radosgw-admin: bucket reshard needs --num-shards to be specified Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc commit b2cc000bbdb7e02e3fa9bdc7d7d71d3e979fee2b Author: Yehuda Sadeh Date: Sat Sep 24 05:49:37 2016 -0700 cls/rgw: fix bi_list objclass command was filtering entries, even if filter was not specified, and need to set boundary for plain entries. Also, list_instance_entries() was not working correctly, and added list_olh_entries(). Signed-off-by: Yehuda Sadeh commit 53982a2e61614398de2e37705da12aa6874360a0 Author: Yehuda Sadeh Date: Mon Sep 26 16:09:34 2016 -0700 rgw_admin: bucket rehsrading, initial work Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_admin.cc commit 995d3a9c49c04d6ded62aa34cfaacc650b7d13a6 Merge: c2a8f05 e4038a0 Author: Josh Durgin Date: Thu Sep 29 21:34:49 2016 -0700 Merge pull request #1192 from ceph/wip-offline-split-hammer2 ceph_manager: test offline split via ceph-objectstore-tool Reviewed-by: Josh Durgin commit 8e13e7ce98e99d3ef1b2942f06b4c9ab35c12066 Merge: e2d4f0a 99bb9f6 Author: Josh Durgin Date: Thu Sep 29 21:34:26 2016 -0700 Merge pull request #11253 from ceph/wip-offline-split-hammer2 ceph-objectstore-tool: add a way to split filestore directories offline Reviewed-by: Josh Durgin commit e4038a0c0068569cc1c7bcaf1b590fba31291610 Author: Josh Durgin Date: Fri Aug 5 18:16:20 2016 -0700 ceph_manager: test offline split via ceph-objectstore-tool When killing an osd, split all pools with a low threshold. This will slow down tests, but should not impact correctness. Signed-off-by: Josh Durgin (cherry picked from commit f28f881bda0ad426bfa9c0e22cc4658b2ce2ec5d) commit 99bb9f603f2123e81470a819c1cd64df13a22425 Author: Josh Durgin Date: Fri Aug 5 11:45:00 2016 -0700 ceph-objectstore-tool: add a way to split filestore directories offline Use the usual split code, and split each dir that meets the usual split criteria. This can be run with lower than usual split settings, to avoid costly online splits. To make sure the directories are not merged again, use a load merge threshold (e.g. filestore merge threshold = 1), and adjust the split multiplier accordingly. Fixes: http://tracker.ceph.com/issues/17220 Signed-off-by: Josh Durgin (cherry picked from commit e7b0428e0e8d8f5459311dc698d94a3ac4f04684) Conflicts: src/tools/ceph_objectstore_tool.cc * remove c++11 auto usage * change HashIndex::list_subdirs() call to use set instead of vector * adjust to hammer signature of coll_t::is_pg() commit c1b64c8f9c23473b758300958a94a172f1d39b64 Author: Yehuda Sadeh Date: Thu Sep 10 12:52:43 2015 -0700 rgw: rgw_obj encoding fixes Fix a few issues: - conversion to and from rgw_obj_key - strip_namespace_from_object() in the case where object starts with underscore - encoding if object has either namespace or instance and starts with underscore Signed-off-by: Yehuda Sadeh commit c381cc5d69ebec4370ee18e350b9d003e15b2770 Author: Yehuda Sadeh Date: Mon Sep 26 16:09:15 2016 -0700 rgw: utilities to support raw bucket index operations and other related changes. Signed-off-by: Yehuda Sadeh Conflicts: src/rgw/rgw_rados.cc src/rgw/rgw_rados.h commit d41cbb44c55cf2dca5ab25d5a1ec76e30db26150 Author: Yehuda Sadeh Date: Mon Sep 26 16:06:17 2016 -0700 rgw: use bucket_info.bucket_id instead of marker where needed We used to use these interchangeably, but they actually have diffent meaning. The marker is the prefix we assign to the objects in this bucket, whereas the bucket_id is the bucket instance's id. These used to hold the same value, but with bucket resharding it's not going to be true anymore. Signed-off-by: Yehuda Sadeh commit 228f52cca1866c40a3840e06bd260c1d92d59caa Author: Yehuda Sadeh Date: Mon Sep 26 16:01:39 2016 -0700 cls/rgw: utilities to support raw bucket index operations New flavour of bi_put() call, and a function to extract key off a raw bi entry. Signed-off-by: Yehuda Sadeh commit e2d4f0af387869569a8c143fa2d2873e6788d2a2 Merge: 8f66abd 0b42082 Author: Casey Bodley Date: Tue Sep 20 10:33:02 2016 -0400 Merge pull request #11140 from cbodley/wip-radosgw-admin-man-hammer hammer: add orphan options to radosgw-admin --help and man page Reviewed-by: Ken Dreyer commit 0b420821fd3ed33d077ce76beef7a6f1a0e5edb7 Author: Casey Bodley Date: Tue Sep 20 09:27:52 2016 -0400 man: add orphan options to radosgw-admin.8 Signed-off-by: Casey Bodley commit 054e0d45c351525454517472df2c0b1dcecb5c39 Author: tserlin Date: Mon Sep 19 14:40:12 2016 -0400 Add two options to radosgw-admin.rst manpage Add '--job-id' and '--max-concurrent-ios' to Orphan Search Options Fixes: http://tracker.ceph.com/issues/17281 Signed-off-by: Thomas Serlin (cherry picked from commit 697f30d86f49b73c981c06375ab2937570b1db01) commit 2920334210376bb34e59d6ecf08557732bcc3861 Author: Ken Dreyer Date: Thu Sep 15 12:56:39 2016 -0600 radosgw-admin: add "--orphan-stale-secs" to --help The radosgw-admin --help did not include the description of the `--orphan-stale-secs` option of the `orphans find` command. The option sets the number of seconds to wait before declaring an object to be an orphan. Fixes: http://tracker.ceph.com/issues/17280 Signed-off-by: Ken Dreyer (cherry picked from commit 354059ae43b4f4cc797da1669715399cd96a4738) commit 34ecb3584230db8458f193ac01deff9264cd119a Author: Abhishek Lekshmanan Date: Fri Apr 1 13:46:30 2016 +0200 rgw_admin: improve the orphans find help Adding a few missing commandline switches and improve the help message Signed-off-by: Abhishek Lekshmanan (cherry picked from commit 27e4c46f741a5f908d5c8ca1af227b3581c697f6) commit 3575fa8112ac39b1c6edf2aaee5b02aa67fa5766 Author: Ken Dreyer Date: Thu Sep 15 11:40:14 2016 -0600 doc: add "--orphan-stale-secs" to radosgw-admin(8) The radosgw-admin(8) manual page did not include the description of the `--orphan-stale-secs` option of the `orphans find` command. The option sets the number of seconds to wait before declaring an object to be an orphan. Fixes: http://tracker.ceph.com/issues/17280 Signed-off-by: Ken Dreyer (cherry picked from commit a676c516069cc448591018ecf4f7d1f7f7bc3bfd) commit 8f66abd02ed5f0bc697b80b3071f0c70886aab6e Merge: fe6d859 c7f6b47 Author: Casey Bodley Date: Wed Sep 7 13:06:33 2016 -0400 Merge pull request #10839 from oritwas/hammer-default-quota Hammer default quota Reviewed-by: Daniel Gryniewicz