swift-developers-japan
main / testing
2 9
1
一つのテストケースに複数のアサーションを書いてしまうと、もしアサーションの評価が失敗だったときにどれが失敗したのかがわかりにくいという問題です。 の「詳しくは」先のコメント https://qiita.com/hmhmsh/items/842e795d4b2a41556b5b#comment-a9bd5d57270c1eebfee2 ですが、XCTAssert系は失敗しても止まらないですよ。
1XCTSAssert 系メソッドを書いてます。「XCTAssert系は失敗しても止まらない」ので、↓を作ったときは失敗の数が減っていくのを確認しながらバグフィックスしました。 https://github.com/koher/EasyImagy/blob/dev-0.4.0/Tests/EasyImagyTests/ExtrapolationTests.swift 
5
viewDidAppear(:) で呼ばれるメソッド等をテストしたい場合って皆さんどうしてますか？ let viewController = HogeViewController() window.rootViewController = viewController window.makeKeyAndVisible() let expectation = XCTestExpectation(description: "wait viewDidAppear") DispatchQueue.main.asyncAfter(deadline: .now() + 0.1) { XCTContext.runActivity(named: "viewDidAppearでメソッドがコールされた事を確認", block: { (_) in XCTAssertTrue(viewController.calledViewDidAppear) }) expectation.fulfill() } wait(for: [expectation], timeout: 0.2) みたいなコードが乱立するとユニットテストの時間がどんどん長くなるんじゃないかという事を危惧しています。
1
When running several simulators simultaneously you may exceed the maximum number of processes or maximum open file limits. If this happens attempts to start new processes or open more files will fail. You can recover by shutting down some simulators or closing open programs. macOS 10.13 automatically scales these limits based on available system memory. On earlier releases these limits are fixed values. These limits can be increased by using launchctl. For more information, choose Help > Simulator Help and navigate to Troubleshoot Simulator > Insufficient resources. (31179087)
1
XCTAssert(xs.contains(4)) | | | | false 4 [1, 2, 3] SwiftPowerAssertがそこそこ安定してきたのでバージョン0.1.0として公開しました。 https://github.com/kishikawakatsumi/SwiftPowerAssert 現時点でもTDDスタイルの開発などにけっこう便利に使えるような気がします。 簡単に試せるようにオンラインのPlaygroundも用意しました。 https://swift-power-assert.kishikawakatsumi.com/ 使ってみてうまく動かないパターンを教えてもらえると嬉しいです。
19
1
1
3
1
preconditionFailure ? https://github.com/apple/swift/blob/master/stdlib/public/Darwin/XCTest/XCTest.swift#L391 ThrowAssertion()ってのがあるのね。 https://github.com/Quick/Nimble/blob/master/Sources/Nimble/Matchers/ThrowAssertion.swift
Nimbleは、僕が避けたMach exceptionsの仕組みを使うライブラリを利用してXcodeのlldbと共存出来てるのすごい。 https://github.com/mattgallagher/CwlPreconditionTesting 
1
1 
swift api-digesterを使ってる。 https://github.com/apple/swift-nio/blob/master/scripts/check_no_api_breakages.sh#L100-L101 
async な API をテストするときのベストプラクティス的な方法ってありますか？↓ここに書かれている extension ？ https://github.com/Quick/Quick/issues/1084#issuecomment-1007665281 
2 2
2
1
6
Bitrise Pipelines に移行して、クレジットを節約しながら並列でビルド・テストを回す https://speakerdeck.com/treastrain/migrate-to-bitrise-pipelines-and-save-credits-while-run-builds-and-tests-in-parallel
2
1
func XCTAssertGreaterThanOrPrint(_ actual: Float, _ expected: Float, file: StaticString = #file, line: UInt = #line) { if actual > expected { print("actual: \(actual)") return } XCTAssertGreaterThan(actual, expected, file: file, line: line) } こんな感じで print 付きのラッパーを作るとかですかね。 成功だけどエディタ上に表示する方法は知らないです、無い気がします。 
1
1
1 1
1
Test Suite 'GSetTests' started at 2023-05-02 09:56:52.910 Test Case '-[LWWElementDictionaryTests.GSetTests testAppend]' started. Test Case '-[LWWElementDictionaryTests.GSetTests testAppend]' passed (0.001 seconds). Test Case '-[LWWElementDictionaryTests.GSetTests testCompare]' started. Test Case '-[LWWElementDictionaryTests.GSetTests testCompare]' passed (0.001 seconds). Test Case '-[LWWElementDictionaryTests.GSetTests testContains]' started. Test Case '-[LWWElementDictionaryTests.GSetTests testContains]' passed (0.000 seconds). Test Case '-[LWWElementDictionaryTests.GSetTests testMerge]' started. Test Case '-[LWWElementDictionaryTests.GSetTests testMerge]' passed (0.000 seconds). Test Case '-[LWWElementDictionaryTests.GSetTests testReplace]' started. Test Case '-[LWWElementDictionaryTests.GSetTests testReplace]' passed (0.000 seconds). Test Case '-[LWWElementDictionaryTests.GSetTests testSubscript]' started. /Users/katsumi/Developer/LWWElementDictionary/LWWElementDictionaryTests/GSetTests.swift:70: error: -[LWWElementDictionaryTests.GSetTests testSubscript] : XCTAssertNil failed: "a" Test Case '-[LWWElementDictionaryTests.GSetTests testSubscript]' failed (0.015 seconds). Test Suite 'GSetTests' failed at 2023-05-02 09:56:52.929. Executed 6 tests, with 1 failure (0 unexpected) in 0.018 (0.019) seconds コマンドラインから実行したとき（xcodebuild test ~）は個々のテストケースのログが出なくなってる？ Test suite 'GSetTests' started on 'My Mac - xctest (57795)' Test case 'GSetTests.testAppend()' passed on 'My Mac - xctest (57795)' (0.001 seconds) Test case 'GSetTests.testCompare()' passed on 'My Mac - xctest (57795)' (0.001 seconds) Test case 'GSetTests.testContains()' passed on 'My Mac - xctest (57795)' (0.000 seconds) Test case 'GSetTests.testMerge()' passed on 'My Mac - xctest (57795)' (0.001 seconds) Test case 'GSetTests.testReplace()' passed on 'My Mac - xctest (57795)' (0.008 seconds) Test case 'GSetTests.testSubscript()' failed on 'My Mac - xctest (57795)' (0.021 seconds)
2
10 7
@Test の arguments でテストケースを増やしてますが，0.10.0 時点ではこんな感じですね．(xcodebuild じゃないのでそこで違いはあるかもしれないですが) https://github.com/kkebo/zyphy/actions/runs/9456496307/job/26048489628#step:7:387
@Test の arguments でテストケースを増やしてますが，0.10.0 時点ではこんな感じですね．(xcodebuild じゃないのでそこで違いはあるかもしれないですが) https://github.com/kkebo/zyphy/actions/runs/9456496307/job/26048489628#step:7:387
✘ Test namedCharRef() recorded an issue at HTMLEntitiesTests.swift:16:5: Expectation failed: (Metadata(duration: .seconds(0), resolution: .init(width: 1920, height: 1080)) → Metadata(duration: 0.0 seconds, resolution: Foundation.CGSize(width: 1920.0, height: 1080.0))) == (Metadata(duration: .seconds(90), resolution: .init(width: 3840, height: 2160)) → Metadata(duration: 90.0 seconds, resolution: Foundation.CGSize(width: 3840.0, height: 2160.0)))
3
2
@Suite struct SomeTest { private static let dataSets: [(a: String, b: String, _ c: String)] = [ ("a", "b", "c"), ("d", "e", "f"), ] @Test(arguments: dataSets) // ← OK func doSomethingABC(_ a: String, _ b: String, c: String) { } @Test(arguments: dataSets.map { ($0.a, $0.b) }) // ← NG func doSomethingAB(_ a: String, _ b: String) { } @Test(arguments: dataSets.map { ($0.a, $0.c) }) // ← NG func doSomethingAC(_ a: String, _ c: String) { } }
@Suite struct SomeTest { private static let dataSets: [(a: String, b: String, c: String)] = [ ("a", "b", "c"), ("d", "e", "f"), ] @Test(arguments: dataSets) func doSomethingABC(_ a: String, _ b: String, _ c: String) { } @Test(arguments: dataSets) func doSomethingAB(_ a: String, _ b: String, _: String) { } @Test(arguments: dataSets) func doSomethingAC(_ a: String, _: String, _ c: String) { } } 2
#expect(exitsWith:) で挟んだ領域を別プロセスで実行してステータスコードなどを見るらしい 1
@Test func helloWorld() { let greeting = "Hello, world!" #expect(greeting == "Hello") // Expectation failed: (greeting → "Hello, world!") == "Hello" } ◇ Test run started. ↳ Testing Library Version: 6.2-dev (a7b5435933149b6) ↳ Target Platform: x86_64-unknown-linux-gnu ◇ Test helloWorld() started. ✘ Test helloWorld() recorded an issue at <stdin>:5:3: Expectation failed: (greeting → "Hello, world!") == "Hello" ✘ Test helloWorld() failed after 0.001 seconds with 1 issue. ✘ Test run with 1 test failed after 0.002 seconds with 1 issue.
import Testing @Test func helloWorld() { let greeting = "Hello, world!" #expect(greeting == "Hello, world!") } await Testing.__swiftPMEntryPoint() as Never swift testing -
<stdin>:8:15: warning: will never be executed 4 | #expect(greeting == "Hello, world!") 5 | } 6 | await Testing.__swiftPMEntryPoint() as Never | `- note: a call to a never-returning function 7 | 8 | await Testing.__swiftPMEntryPoint() as Never | `- warning: will never be executed 9 | ◇ Test run started. ↳ Testing Library Version: 6.2-dev (a7b5435933149b6) ↳ Target Platform: x86_64-unknown-linux-gnu ◇ Test helloWorld() started. ✔ Test helloWorld() passed after 0.001 seconds. ✔ Test run with 1 test passed after 0.001 seconds.
import Testing @Test func helloWorld() { let greeting = "Hello, world!" #expect(greeting == "Hello, world!") } await Testing.__swiftPMEntryPoint() as Never swift - exit status: 69 with ◇ Test run started. ↳ Testing Library Version: 6.2-dev (a7b5435933149b6) ↳ Target Platform: x86_64-unknown-linux-gnu ✔ Test run with 0 tests passed after 0.001 seconds.
mainを作るので見つけてくれる。 @swift-main swiftc import Testing @Test func helloWorld() { let greeting = "Hello, world!" #expect(greeting == "Hello, world!") } await Testing.__swiftPMEntryPoint() as Never ◇ Test run started. ↳ Testing Library Version: 6.2-dev (a7b5435933149b6) ↳ Target Platform: x86_64-unknown-linux-gnu ◇ Test helloWorld() started. ✔ Test helloWorld() passed after 0.001 seconds. ✔ Test run with 1 test passed after 0.001 seconds.
@Test func helloWorld() { let greeting = "Hello, world!" #expect(greeting == "Hello, world!") // Expectation failed: (greeting → "Hello, world!") == "Hello" } ◇ Test run started. ↳ Testing Library Version: 6.2-dev (cabf4d419cf9c8c) ↳ Target Platform: x86_64-unknown-linux-gnu ◇ Test helloWorld() started. ✔ Test helloWorld() passed after 0.074 seconds. ✔ Test run with 1 test passed after 0.078 seconds. 2
import Testing struct MyRecursiveSuiteTrait: SuiteTrait & TestTrait & TestScoping { var isRecursive: Bool { true } func provideScope( for test: Test, testCase: Test.Case?, performing function: () async throws -> Void ) async throws { print("enter test") defer { print("leave test") } try await function() } } extension Trait where Self == MyRecursiveSuiteTrait { static var mySuperSuite: Self { Self() } } // a. ここで Suite trait として1回呼ばれる @Suite(.mySuperSuite) struct MyTest { // b. ここで Suite trait として1回呼ばれる // c. ここで Test trait として1回呼ばれる @Test func foo() { print("foo") } // d. ここで Suite trait として1回呼ばれる // e. ここで Test trait として1回呼ばれる @Test func bar() { print("bar") } } enter test enter test bar leave test foo leave test◇ Test run started. ↳ Testing Library Version: 6.2 (3fdabe5392108d8) ↳ Target Platform: aarch64-unknown-linux-gnu ◇ Suite MyTest started. ◇ Test foo() started. ◇ Test bar() started. ✔ Test bar() passed after 0.001 seconds. ✔ Test foo() passed after 0.001 seconds. ✔ Suite MyTest passed after 0.001 seconds. ✔ Test run with 2 tests in 1 suite passed after 0.001 seconds.
import Testing struct MyRecursiveSuiteTrait: SuiteTrait & TestTrait & TestScoping { var isRecursive: Bool { true } func scopeProvider(for test: Test, testCase: Test.Case?) -> MyRecursiveSuiteTrait? { print("scopeProvider called", test.name, testCase == nil ? "suite" : "test") return self } func provideScope( for test: Test, testCase: Test.Case?, performing function: () async throws -> Void ) async throws { print("enter provideScope", test.name, testCase == nil ? "suite" : "test") defer { print("leave provideScope", test.name, testCase == nil ? "suite" : "test") } try await function() } } extension Trait where Self == MyRecursiveSuiteTrait { static var mySuperSuite: Self { Self() } } // a. ここで Suite trait として1回呼ばれる @Suite(.mySuperSuite) struct MyTest { // b. ここで Suite trait として1回呼ばれる // c. ここで Test trait として1回呼ばれる @Test func foo() { print("foo") } // d. ここで Suite trait として1回呼ばれる // e. ここで Test trait として1回呼ばれる @Test func bar() { print("bar") } } scopeProvider called MyTest suite enter provideScope MyTest suite scopeProvider called bar() suite enter provideScope bar() suite scopeProvider called foo() suite enter provideScope foo() suite scopeProvider called bar() test enter provideScope bar() test bar leave provideScope bar() test scopeProvider called foo() test enter provideScope foo() test leave provideScope bar() suite foo leave provideScope foo() test leave provideScope foo() suite leave provideScope MyTest suite◇ Test run started. ↳ Testing Library Version: 6.2 (3fdabe5392108d8) ↳ Target Platform: aarch64-unknown-linux-gnu ◇ Suite MyTest started. ◇ Test bar() started. ◇ Test foo() started. ✔ Test bar() passed after 0.001 seconds. ✔ Test foo() passed after 0.001 seconds. ✔ Suite MyTest passed after 0.001 seconds. ✔ Test run with 2 tests in 1 suite passed after 0.001 seconds.
import Testing struct MyRecursiveSuiteTrait: SuiteTrait & TestScoping { func provideScope( for test: Test, testCase: Test.Case?, performing function: () async throws -> Void ) async throws { print("enter provideScope", test.name, testCase == nil ? "suite" : "test") defer { print("leave provideScope", test.name, testCase == nil ? "suite" : "test") } try await function() } } extension Trait where Self == MyRecursiveSuiteTrait { static var mySuperSuite: Self { Self() } } // a. ここで Suite trait として1回呼ばれる @Suite(.mySuperSuite) struct MyTest { // b. ここで Suite trait として1回呼ばれる // c. ここで Test trait として1回呼ばれる @Test func foo() { print("foo") } // d. ここで Suite trait として1回呼ばれる // e. ここで Test trait として1回呼ばれる @Test func bar() { print("bar") } } enter provideScope MyTest suite bar foo leave provideScope MyTest suite◇ Test run started. ↳ Testing Library Version: 6.2 (3fdabe5392108d8) ↳ Target Platform: aarch64-unknown-linux-gnu ◇ Suite MyTest started. ◇ Test bar() started. ◇ Test foo() started. ✔ Test bar() passed after 0.001 seconds. ✔ Test foo() passed after 0.001 seconds. ✔ Suite MyTest passed after 0.001 seconds. ✔ Test run with 2 tests in 1 suite passed after 0.001 seconds.
import Testing struct MyRecursiveSuiteTrait: SuiteTrait & TestTrait & TestScoping { func scopeProvider(for test: Test, testCase: Test.Case?) -> MyRecursiveSuiteTrait? { print("scopeProvider called", test.name, testCase == nil ? "suite" : "test") return self } func provideScope( for test: Test, testCase: Test.Case?, performing function: () async throws -> Void ) async throws { print("enter provideScope", test.name, testCase == nil ? "suite" : "test") defer { print("leave provideScope", test.name, testCase == nil ? "suite" : "test") } try await function() } } extension Trait where Self == MyRecursiveSuiteTrait { static var mySuperSuite: Self { Self() } } // a. ここで Suite trait として1回呼ばれる @Suite(.mySuperSuite) struct MyTest { // b. ここで Suite trait として1回呼ばれる // c. ここで Test trait として1回呼ばれる @Test func foo() { print("foo") } // d. ここで Suite trait として1回呼ばれる // e. ここで Test trait として1回呼ばれる @Test func bar() { print("bar") } } scopeProvider called MyTest suite enter provideScope MyTest suite foo bar leave provideScope MyTest suite◇ Test run started. ↳ Testing Library Version: 6.2 (3fdabe5392108d8) ↳ Target Platform: aarch64-unknown-linux-gnu ◇ Suite MyTest started. ◇ Test foo() started. ◇ Test bar() started. ✔ Test foo() passed after 0.001 seconds. ✔ Test bar() passed after 0.001 seconds. ✔ Suite MyTest passed after 0.001 seconds. ✔ Test run with 2 tests in 1 suite passed after 0.001 seconds.
import Testing struct MyRecursiveSuiteTrait: SuiteTrait & TestTrait & TestScoping { var isRecursive: Bool { true } func provideScope( for test: Test, testCase: Test.Case?, performing function: () async throws -> Void ) async throws { print("enter provideScope", test.name, testCase == nil ? "suite" : "test") defer { print("leave provideScope", test.name, testCase == nil ? "suite" : "test") } try await function() } } extension Trait where Self == MyRecursiveSuiteTrait { static var mySuperSuite: Self { Self() } } // a. ここで Suite trait として1回呼ばれる @Suite(.mySuperSuite) struct MyTest { // b. ここで Suite trait として1回呼ばれる // c. ここで Test trait として1回呼ばれる @Test func foo() { print("foo") } // d. ここで Suite trait として1回呼ばれる // e. ここで Test trait として1回呼ばれる @Test func bar() { print("bar") } } enter provideScope foo() test foo leave provideScope foo() test enter provideScope bar() test bar leave provideScope bar() test◇ Test run started. ↳ Testing Library Version: 6.2 (3fdabe5392108d8) ↳ Target Platform: aarch64-unknown-linux-gnu ◇ Suite MyTest started. ◇ Test foo() started. ◇ Test bar() started. ✔ Test foo() passed after 0.001 seconds. ✔ Test bar() passed after 0.001 seconds. ✔ Suite MyTest passed after 0.001 seconds. ✔ Test run with 2 tests in 1 suite passed after 0.001 seconds.