因此,如果我正确理解您的用例,您就不能指望在频道上发送并在之后立即阅读结果。您不知道工作人员何时会处理该发送,您需要在 goroutine 之间进行通信,这是通过通道完成的。假设仅调用具有返回值的函数在您的场景中不起作用,如果您确实需要发送给工作人员,然后阻塞直到获得结果,您可以发送通道作为数据结构的一部分,然后阻塞-发送后接收它,即:
resCh := make(chan Result)
ch <- Data{key, value, resCh}
res := <- resCh
但是您可能应该尝试将工作分解为独立步骤的管道,请参阅我在原始答案中链接到的博客文章。
我认为它是单个生产者的原始答案- 多个消费者/工人模式:
这是 Go 的 goroutine 和通道语义非常适合的常见模式。您需要记住以下几点:
main 函数不会自动等待 goroutine 完成。如果在 main 中没有其他事情可做,那么程序将退出并且您没有结果。
您使用的全局映射不是线程安全的。您需要通过互斥锁同步访问,但有一个更好的方法 - 使用输出通道获取结果,该通道已经同步。
您可以在通道上使用 for..range,并且可以在多个 goroutine 之间安全地共享通道。正如我们将看到的,这使得这个模式写起来非常优雅。
游乐场: https: //play.golang.org/p/WqyZfwldqp
有关 Go 管道和并发模式的更多信息,介绍错误处理、提前取消等:https ://blog.golang.org/pipelines
您提到的用例的注释代码:
// could be a command-line flag, a config, etc.
const numGoros = 10
// Data is a similar data structure to the one mentioned in the question.
type Data struct {
key string
value int
}
func main() {
var wg sync.WaitGroup
// create the input channel that sends work to the goroutines
inch := make(chan Data)
// create the output channel that sends results back to the main function
outch := make(chan Data)
// the WaitGroup keeps track of pending goroutines, you can add numGoros
// right away if you know how many will be started, otherwise do .Add(1)
// each time before starting a worker goroutine.
wg.Add(numGoros)
for i := 0; i < numGoros; i++ {
// because it uses a closure, it could've used inch and outch automaticaly,
// but if the func gets bigger you may want to extract it to a named function,
// and I wanted to show the directed channel types: within that function, you
// can only receive from inch, and only send (and close) to outch.
//
// It also receives the index i, just for fun so it can set the goroutines'
// index as key in the results, to show that it was processed by different
// goroutines. Also, big gotcha: do not capture a for-loop iteration variable
// in a closure, pass it as argument, otherwise it very likely won't do what
// you expect.
go func(i int, inch <-chan Data, outch chan<- Data) {
// make sure WaitGroup.Done is called on exit, so Wait unblocks
// eventually.
defer wg.Done()
// range over a channel gets the next value to process, safe to share
// concurrently between all goroutines. It exits the for loop once
// the channel is closed and drained, so wg.Done will be called once
// ch is closed.
for data := range inch {
// process the data...
time.Sleep(10 * time.Millisecond)
outch <- Data{strconv.Itoa(i), data.value}
}
}(i, inch, outch)
}
// start the goroutine that prints the results, use a separate WaitGroup to track
// it (could also have used a "done" channel but the for-loop would be more complex, with a select).
var wgResults sync.WaitGroup
wgResults.Add(1)
go func(ch <-chan Data) {
defer wgResults.Done()
// to prove it processed everything, keep a counter and print it on exit
var n int
for data := range ch {
fmt.Println(data.key, data.value)
n++
}
// for fun, try commenting out the wgResults.Wait() call at the end, the output
// will likely miss this line.
fmt.Println(">>> Processed: ", n)
}(outch)
// send work, wherever that comes from...
for i := 0; i < 1000; i++ {
inch <- Data{"main", i}
}
// when there's no more work to send, close the inch, so the goroutines will begin
// draining it and exit once all values have been processed.
close(inch)
// wait for all goroutines to exit
wg.Wait()
// at this point, no more results will be written to outch, close it to signal
// to the results goroutine that it can terminate.
close(outch)
// and wait for the results goroutine to actually exit, otherwise the program would
// possibly terminate without printing the last few values.
wgResults.Wait()
}
在实际场景中,工作量无法提前知道,通道内的关闭可能来自例如 SIGINT 信号。只要确保在通道关闭后没有代码路径可以发送工作,因为这会导致恐慌。